Location: Brussels
Activity: Hybrid - 2/3 days on-site
Duration: 12 months + extensions
Education and professional background:
- Bachelor or Master Degree
- 5-7 years of experience as a data engineer or similar position
Languages:
- Fluent in either Dutch or French
- Fluent in English
Travels:
- Travel is not required structurally
- Occasional travel in the context of a project might be required
Context:
As Data engineer, you will be part of the B2B Supply Belgium business platform. The main focus is serving B2B customers in Belgium with power / gas, products and services, green energy. The business platform consists of approximately 180 people, from which 130 on business side and 50 on IS and DATA side.
Role:
We are seeking a skilled and experienced Data Engineer to join our Data Foundation team.You will be responsible for designing and implementing scalable, efficient, and robust data pipelines, Data Models, … to support our data-driven initiatives. Close collaboration with cross-functional teams, analysts, project managers is a must in order to ensure that data is available, accessible, and actionable.
Responsibilities:
- Design, implement, and maintain scalable data architectures, including databases, AWS data lakes, and data warehouses in line with the existing Engie tools and frameworks.
- Build and optimize ETL (Extract, Transform, Load) processes to move data from various sources to data repositories.
- Combine diverse data sources into cohesive, unified views (gold datasources) for analysis and reporting purposes.
- Ensure data consistency, accuracy, and quality throughout the data lifecycle.
- Manage and optimize the data infrastructure, including storage, processing, and retrieval systems in terms of efficiency, storage and costs.
- Collaborate with various teams to ensure the scalability, security, and performance of data systems.
- Develop and maintain code for data processing tasks using languages such as Python, Spark, SQL and ensure they are automated and run on a regular basis.
- Work closely with cross-functional teams, analysts, and software developers, to understand data requirements and deliver solutions.
- Collaborate with business stakeholders to gather and understand data-related requirements.
- Create and maintain comprehensive documentation for data processes, pipelines, and architectures.
- Ensure that data engineering best practices are followed.
- Share best practices with all data stakeholders, both IT and business.
- Must have:
- Proven experience as a Senior Data Engineer or in a similar role
- Proven experience on Data Platform Management
- Effective Experience with AWS services such as S3, Athena, Glue, Redshift
- Effective experience in Databricks (preferably on AWS)
- Strong programming skills in Python, Spark, SQL, or another data engineering language
- Experience with data processing technologies
- Knowledge of Agile processes (scrum, Kanban)
- Knowledge of DataIku
- Knowledge of Azure Devops & release Pipelines
- AWS certifications ( Cloud Data Engineer)
- Good to have:
- A first experience in utilities market is a plus
- Knowledge of technical systems like Salesforce, SAP ISU
- Knowledge of Agile tools like Azure Devops or Jira
- Familiar with financial closing reports
- AWS certifications ( Solution Architect, Systems Administrator)
Login and apply | Register and apply |