Senior Data Engineer

Company:
Location: Remote

*** Mention DataYoshi when applying ***

Project Description

Major airline is researching an efficient way to place flights at gates in a timely manner to reduce delay penalties. In doing so, we need to be able to create data visualizations to understand the output of our predictions, assess operations research models, and work with the team to implement changes.

Responsibilities

Skills

Must have

    Min qualifications - education and prior job experience
    • Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training
    • 3 years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
    • 3 years data analytics experience using SQL
    • 2 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
    • Combination of Development, Administration & Support experience in several of the following tools/platforms required:
    Scripting: Python, Spark, Unix, SQL
    Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake, Azure Data Explorer. Administration skills a plus
    Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions
    CI/CD: GitHub, Jenkins, Azure DevOps, Terraform
    BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana
    Data Warehousing: DataStage, Informatica
    Data Governance and Privacy: Informatica Axon and EDC, BigID

    Preferred Qualifications- Education & Prior Job Experience
    5+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
    5+ years data analytics experience using SQL
    3+ years full-stack development experience, preferably in Azure
    3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
    Airline Industry Experience

Nice to have

    Python, Spark, Unix, SQL

Languages

English: C2 Proficient

Seniority

Regular

Relocation package

If needed, we can help you with relocation process.

Work Type

DWH Development

Ref Number

VR-65786

*** Mention DataYoshi when applying ***

Offers you may like...

  • Springer Nature

    Senior Data Scientist - CA Data
    Lisboa
  • IBM

    Senior Data Scientist
    Bengaluru, Karnataka
  • PriceHubble

    SENIOR DATA SCIENTIST
    Wien, W
  • Klarna

    Senior Data Scientist
    Milano, Lombardia
  • Grab

    Digibank - Senior Data Scientist (Analytics)
    Singapore