Lead Data Engineer

We are currently staffing a permanent, Lead Data Engineer role @ a leading energy solutions company in Hamburg.

In this role, you will join the Analytics & AI team. As part of this team, you will oversee the development and management of sophisticated data processing systems in the data platform on Azure Cloud. This role involves advancing data solutions on Databricks, optimizing data acquisition via Azure Data Factory, Logic Apps, Azure Functions, Spark and ensuring quality assurance for data pipelines.

You should have 5+ years of experience in Data Engineering, some (lateral) team leadership, and in-depth Azure Data Data Factory & Databricks experience.

Furthermore, you should have high-level Python and SQL skills and a comprehensive understanding of Big Data technologies like Hadoop, Spark or related distributed computing frameworks.

| REMOTE SETUP

You can work remotely from Germany - with approximately 1-2 meetings/ month in the Hamburg office. If you have to travel or relocate to Hamburg for this role, then your cost will be covered.

| ABOUT THE ROLE

In this role, you will work on the following topics:

• Technical Leadership and Best Practices
  
  

Provide strong technical leadership and guidance to a team of data engineers, ensuring adherence to best practices in data engineering, cloud computing, and data security.

• Streamlining Data Acquisition
  
  

Optimize data acquisition processes using Azure Data Factory, Logic Apps, and Azure Functions to improve efficiency and accuracy.

• Quality Assurance
  
  

Implement robust validation, error handling, and performance consistency across various data sources and processes to ensure the highest quality of data pipelines.

• Scalability and Performance
  
  

Oversee and enhance the scalability of data processing systems, ensuring they can manage increasing data volumes and complex processing needs while maintaining high performance.

• Cost Optimization
  
  

Continuously monitor and optimize cloud resource usage and expenses, implementing cost-effective solutions without compromising performance and scalability.

• Automation and CI/CD
  
  

Implement and maintain continuous integration and deployment (CI/CD) practices for data pipelines to improve efficiency, reduce manual errors, and accelerate deployment processes.

| WHAT YOU WILL GET

• Lead, coach and grow a team of Data Engineers to develop and optimize an industry-leading data platform, which helps to improve the efficiency within different segments of the energy value chain
• Salary of up to 105k€ / year
• Company Pension scheme (+~6% yearly salary) and extensive health and wellbeing-focused list of perks (i.e. 38-hour work week, 30+6 days vacation, nanny support, jobrad, ...)
• 1.300€ extra holiday payment
• Fully Remote setup & a strong focus on individual flexibility
  
  

| NEXT STEPS

If you are interested in this role, we will share additional information about the company and position to support your decision-making process and invite you to a first chat with the head of engineering.