Data Engineer

Senior Data Engineer

We are looking for a Senior Data Engineer who has extensive experience in developing and deploying data pipelines, infrastructure, and models for our data science projects. You will work closely with data scientists to deliver data-driven solutions that meet business needs and goals.

Main Tasks And Responsibilities

• Setup CICD pipelines for all models of the team, ensuring quality, reliability, and scalability
• Take the lead in the transition of the existing models from one existing subscription to a central data platform, following best practices and standards
• Develop infrastructure as code with terraform for the data science projects the team is working on, automating the provisioning and configuration of resources
• Collaborate with data scientists and analysts to understand the data requirements and provide technical support and guidance
• Monitor, troubleshoot, and optimize the performance and efficiency of the data pipelines and infrastructure
• Research and implement new technologies and tools to improve the data engineering processes and capabilities
• Setup and manage services for stream analytics, such as Azure Stream Analytics, Event Hubs, or Kafka
  
  

Required Skills And Qualifications

• Master's degree in Computer Science, Engineering, or related field, or equivalent work experience
• At least 7 years of experience in data engineering, working with large-scale data sets and cloud-based platforms
• Proficient in Python, SQL, and shell scripting
• Experience with CICD tools like Azure DevOps
• Experience with terraform
• Experience with Azure data services, such as Data Factory, Data Lake, Databricks, Synapse, or Stream Analytics
• Strong knowledge of data modeling, ETL, and data quality principles and practices
• Excellent communication, collaboration, and problem-solving skills
• Self-motivated, proactive, and eager to learn and grow
  
  

Referentie:

CV Uploaden*

• verplicht
  
  

Δ