Job description
Data Engineer DataKitchen
Albert Heijn is a renowned supermarket chain that has been serving customers across the Netherlands for over 135 years. Founded in 1887 by Albert Heijn, the company has grown to become one of the most trusted and beloved grocery retailers in the country. With a commitment to quality, convenience, and customer satisfaction, Albert Heijn has become an integral part of the Dutch community's daily lives.
Albert Heijn is accelerating in becoming a Food and Tech Company. That is where AH Technology comes into the picture. With a focus on Data, Digital and Tech, we at Albert Heijn strive to deliver high quality products where technology plays an important role.
Job Description
Part of AH Technology is the Data Differentiation Platform (DDP), where we support the Cloud Services and Data Management within Albert Heijn and deliver THE groundbreaking self-service data platform, called Thor, designed to empower Data Producers and Data Consumers. With Thor, the process of data ingestion, transformation, and utilization becomes seamless, enabling users to unlock the full potential of their data while ensuring compliance with privacy regulations, including handling sensitive information like PII (Personally Identifiable Information).
Till now, teams within DDP have been ingesting the data of the Data Producers into the data platform, supporting the Data Consumers with accessing the data and even creating datasets for them. This is changing in the coming months, where we move towards our new Data Strategy. So, what is the change you might think?
Well, as stated Thor is designed to empower Data Producers and Data Consumers, meaning that Data Producers can onboard their own data in a Self-Service manner, without having a dedicated team within DDP doing this for them. This makes the data flow easier, where a Data Consumers requests the data to the Data Producers, and they ensure it's delivered for them.
Besides ensuring that data ingestion gets easier, DDP is also working on various enablement blocks on the data platform, to make the life of our Consumers easier when it comes to data preparation for data products they work on. You can think of having a standardized package that builds up a DataMart in a few clicks. It is not there yet but soon to come!
So, what will be your job…
We are looking for Data Engineer who can help with the creation of our so called DataKitchen. An inhouse self-built engine for creating DataMarts and datasets on top of our self-service data platform Thor.
You as a data engineer will join a team of Data Engineers that has been exploring all the options there are in the market concerning the creation of a DataMart.
We have various types of Stakeholders, such as Data Analyst, Data Scientists but also PowerBI users.
Our aim is to create a DataMart engine which can be deployed across the organization, allowing consumers to have data modelled like they were used to in our old Data Warehouse called Pallas.
We finished testing our first two PoC’s earlier this year, which was a success! The DataMart engine is now being worked on to go to Production by the end of quarter 2, 2024 and many use cases are waiting for this to happen.
To be able to scale, add additional features and support our DataMart Engine, we need to grow our team. Ensuring we have a stable and mature team that can work towards the future, having our DataKitchen being used in all brands across Europe and maybe even beyond!
That is why we need you!
Key Responsibilities
- Work closely together with the DataKitchen Data Engineers in expanding the foundation for the DataMart Engine
- Support the Product Owner with stakeholder management
- Ensure the DataMart is being built in such manner that it’s a (versioned) package we can deliver, as we won’t be owning the DataMart.
- Train others in making right usage of DataMart engine
- Ensure alignment with architecture and data strategy is there at all times
- Keep building the product in a scalable and cost effective manner
- Ensure the product meets all security guidelines
- Implement observability with proactive monitoring/alerting
- Changes of DataKitchen engine version made available via pull mechanism.
Requirements
- >7 years’ work experience as a Data Engineer
- Experience with Cloud platforms (Microsoft Azure)
- Experienced with Databricks
- Very experienced with Python/SQL/PySpark
- Experienced in running bigger projects and scaling them
- Understanding concepts of Data Modelling, Orchestration and Observability
- Strong communication and teamwork skills, with the ability to effectively collaborate with both technical and non-technical stakeholders
- Lives in Netherlands and can work from Zaandam office minimum 2 days a week, more if required
What we offer
At Albert Heijn we aim to grow, and this is only possible if you grow along with us. As we work together to build our brand and your career, you can count on (based on 40 hours per week):
- An annual salary up to 95k including holiday allowance and a flexible bonus. Depending on your level of seniority and experience;
- A minimum of 20 days paid vacation, optionally 12.5 days extra. Do you want to take that extra time off, or would you rather convert the extra days into discounts or sell them for cash? You’re the end boss!;
- Flexible working hours;
- Access to a challenging training curriculum – AH Tech Academy;
- An excellent pension plan where we as an employer contribute 6 times more than you as an employee;
- A travel allowance or a NS-business card for traveling to and from Zaandam by train;
- 10% staff discount on groceries in all Albert Heijn stores, to a maximum of €300 per year;
- A free Mijn Albert Heijn Premium membership with many benefits;
- A company laptop and telephone
