The digital Services & Solutions department created in 2018 support the development of the new digital products and services, defined by Liebherr as part of its digital transformation strategy.
Liebherr Mining’s is developing an IoT platform to deliver digital products and new services to our customers to help them to create value from the data collected from the machines.
Liebherr Mining is currently looking for a Data Engineer for our office in Colmar. You will work on our Big Data architecture that support our IoT Platform to process all the data related to our machines : Hydraulic Excavators, Oversized Haulage Trucks and Dozers.
Your skills in DevOps and CI/CD domain will be appreciated to deploy the developed components.
Ensure the design and development of Big Data features for our IoT Platform
Design and Implement ingest, clean, transform, enrich pipeline for new HEX operational data and OHT operational data
Prototype and implement the new discovery layer to build a collaborative platform to build new algorithm with engineering department based on Azure ML and Databricks
Implement the processing of the stream layer for HEX and OHT data (GPS location, error and misuses)
Ensure the design and implementation of machine data transformation : ingest, clean and enrich
Ensure the deployment of this features using the latest Azure technologies
Ensure a permanent technology watching in our field of activities
Ensure a permanent communication with the data architect to ensure data guidelines and strategy alignement
Contribute to team competence increase by knowledge sharing
Ensure the implementation apply the development best practices
What technologies do we use?
We are developing VueJS web applications, relying on nodeJs and C# microservices. All our frontend application and micro services are developed natively for the cloud and deployed on Azure, in kubernetes clusters.
Specific data processing and data analytics services are developed in Python and PySpark. All the components are deployed on Azure inside HDInsight cluster using Hadoop components (Spark, Hbase, Airflow..) or inside VM and docker images using pandas libraries. Development activities and R&D activities are done using Jupyter notebooks. A discovery layer will also be used based on Azure ML and databricks components in order to ensure collaboration with engineering teams.
Our team is developing the services applying with the SAFe framework and using Confluence, Jira and bitbucket tools. Competencies
Graduate in MSc Data Engineering for Artificial Intelligence or equivalent studies
At least 3 years of experience working as Data Engineer
At least 3 years of experience working in Python,
A strong experience of Hadoop components (Spark, HBase, Phoenix, HDFS, …) and Airflow
Experience working with Git, Kubernetes and Docker
Experience in Azure components like HDInsight, blob storage and datalake, …
Experienced in working in interdisciplinary teams and in multi-cultural team environments
Solid knowledge of end-to-end project lifecycle, tools and elements of project management (Agile or scrum).
Ability to interact with diverse technical and non-technical groups.
Strong communication skills and facilitation abilities
Priorities management & time management skills
Highly open minded and proven knowledge transfer skills
Fluent English. French and/or German of benefit.
The position is located in Colmar, potential travelling 5-10%
We offer you the opportunity to join a successful international company and to work in a secure and progressive environment, which includes competitive salary and benefits, training and personal development.
Avons-nous suscité votre intérêt ? Si c’est le cas, nous serions ravis de recevoir votre candidature en ligne. Si vous avez des questions, veuillez contacter Virginie Loos à : email@example.com.
Liebherr - One Passion. Many Opportunities.
- Une passion commune. Tant d’opportunités. L'entreprise
La société Liebherr-Mining Equipment Colmar SAS produit une gamme très diversifiée de pelles hydrauliques sur chenilles de 100 à 800 tonnes et godets jusqu’à 42m³. Site
Liebherr-Mining Equipment Colmar SAS
49 Rue Frédéric Hartmann, CS 50038
France (FR) Contact