About The Job
The Lead Data Engineer will be part of the Data Integration team in the Global Data & Analytics organization. The mission of the Data Integration team is to foster usage of data at Danone by compliantly ingesting and exposing needed Data Sources into OneSource platform. Data Integration team provides its services for Global and Local IT & Data teams to support their business needs.
Information management context is moving fast and Danone adapts its Data Strategy in order to become a Data enabled Company. In this context we delivered a first version of our Data & Analytics cloud platform (OneSource) and we need now to scale it.
Your main responsibilities will be as follows
- Provides technical leadership in Azure Data Engineering space
- Manage team of data engineers (both internals and/or externals)
- Own most of the deliverables for the Data team from a delivery perspective
- Drive evaluation, adoption and learn new tools and technologies to keep technology stack modern as needed for the Product solution
About you
- Seek alternative technology solutions to problems
- Participate in new data product or new technology evaluations
- Assist in the decision-making process related to the selection of software architecture solutions
- Lead the effort to build, implement and support the data infrastructure
- Promote re-use and develop consistent scalable patterns
- Develop scalable production ready data integration and processing solutions
- Write and tune complex data jobs
- Resolve issues involving data job failures
Must have
- Master's Degree in Computer Science, and/or Engineering, and/or Statistics, and/or Information Technology, and/or Information Systems with of experience
- 7+ years of experience in programming and high-throughput analysis of data, including integration of large-scale data sets, design and implementation of data processing pipelines, and analysis
- Experience in coaching and managing other engineers. Mentor and assist other engineers in or out of our areas of ownership and expertise
- 5+ years of hands-on experience with Apache Spark™, Apache Spark™ SQL
- 3+ years of experience in implementing Databricks solutions in data analytics space
- Experience with Delta Lake, Delta Sharing, Databricks Delta Live Tables, Databricks Unity Catalog
- Experience or education in Azure Data Stack like Azure Data Lake Storage; Azure Data Factory; Azure Event Hubs
- Be a team player and enjoy collaboration with other engineers and teams
- Leadership in cross-teams situations with no hierarchical link
- Autonomy, initiative, and critical mind
- Ability to work in an international environment
- Languages - Communicative level of English language is required
Nice to have
- Experience in product management in agile framework (SCRUM)
- Experience with task/bug tracking software (JIRA)
- Experience or education in Snowflake, IICS
- Experience with CPG industry
About us
At Danone, we guarantee that you can simply be yourself. We believe that it's up to you to define the way you work, to develop yourself, to progress. With us, you'll work in an exciting, complex and challenging environment. This is how you will create new opportunities!
You will work with world-renowned brands such as Blédina, Evian or Actimel. Be innovative, enterprising and the impact you will have will impress you.
Join our movement for a more sustainable world. One Planet One Health BY YOU.