Job description

Senior Data Engineer

We are looking for a Senior Data Engineer who has extensive experience in developing and deploying data pipelines, infrastructure, and models for our data science projects. You will work closely with data scientists to deliver data-driven solutions that meet business needs and goals.

Main Tasks And Responsibilities

  • Setup CICD pipelines for all models of the team, ensuring quality, reliability, and scalability
  • Take the lead in the transition of the existing models from one existing subscription to a central data platform, following best practices and standards
  • Develop infrastructure as code with terraform for the data science projects the team is working on, automating the provisioning and configuration of resources
  • Collaborate with data scientists and analysts to understand the data requirements and provide technical support and guidance
  • Monitor, troubleshoot, and optimize the performance and efficiency of the data pipelines and infrastructure
  • Research and implement new technologies and tools to improve the data engineering processes and capabilities
  • Setup and manage services for stream analytics, such as Azure Stream Analytics, Event Hubs, or Kafka

Required Skills And Qualifications

  • Master's degree in Computer Science, Engineering, or related field, or equivalent work experience
  • At least 7 years of experience in data engineering, working with large-scale data sets and cloud-based platforms
  • Proficient in Python, SQL, and shell scripting
  • Experience with CICD tools like Azure DevOps
  • Experience with terraform
  • Experience with Azure data services, such as Data Factory, Data Lake, Databricks, Synapse, or Stream Analytics
  • Strong knowledge of data modeling, ETL, and data quality principles and practices
  • Excellent communication, collaboration, and problem-solving skills
  • Self-motivated, proactive, and eager to learn and grow

Referentie:

CV Uploaden*

  • verplicht

Δ

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Progressive Edge
May 27, 2024

Data Engineer & Analyst

KIT-AR
May 27, 2024

Senior Data Engineer

KIT-AR
May 27, 2024

Senior Data Engineer