Data Engineer (m/f)

Company:
Location: Colmar (68)

*** Mention DataYoshi when applying ***

The digital Services & Solutions department created in 2018 support the development of the new digital products and services, defined by Liebherr as part of its digital transformation strategy.
Liebherr Mining’s is developing an IoT platform to deliver digital products and new services to our customers to help them to create value from the data collected from the machines.
Liebherr Mining is currently looking for a Data Engineer for our office in Colmar. You will work on our Big Data architecture that support our IoT Platform to process all the data related to our machines : Hydraulic Excavators, Oversized Haulage Trucks and Dozers.
Your skills in DevOps and CI/CD domain will be appreciated to deploy the developed components.
Responsibilities

Ensure the design and development of Big Data features for our IoT Platform

Design and Implement ingest, clean, transform, enrich pipeline for new HEX operational data and OHT operational data

Prototype and implement the new discovery layer to build a collaborative platform to build new algorithm with engineering department based on Azure ML and Databricks

Implement the processing of the stream layer for HEX and OHT data (GPS location, error and misuses)

Ensure the design and implementation of machine data transformation : ingest, clean and enrich

Ensure the deployment of this features using the latest Azure technologies

Ensure a permanent technology watching in our field of activities

Ensure a permanent communication with the data architect to ensure data guidelines and strategy alignement

Contribute to team competence increase by knowledge sharing

Ensure the implementation apply the development best practices

What technologies do we use?
We are developing VueJS web applications, relying on nodeJs and C# microservices. All our frontend application and micro services are developed natively for the cloud and deployed on Azure, in kubernetes clusters.
Specific data processing and data analytics services are developed in Python and PySpark. All the components are deployed on Azure inside HDInsight cluster using Hadoop components (Spark, Hbase, Airflow..) or inside VM and docker images using pandas libraries. Development activities and R&D activities are done using Jupyter notebooks. A discovery layer will also be used based on Azure ML and databricks components in order to ensure collaboration with engineering teams.
Our team is developing the services applying with the SAFe framework and using Confluence, Jira and bitbucket tools. Competencies

Graduate in MSc Data Engineering for Artificial Intelligence or equivalent studies

At least 3 years of experience working as Data Engineer

At least 3 years of experience working in Python,

A strong experience of Hadoop components (Spark, HBase, Phoenix, HDFS, …) and Airflow

Experience working with Git, Kubernetes and Docker

Experience in Azure components like HDInsight, blob storage and datalake, …

Experienced in working in interdisciplinary teams and in multi-cultural team environments

Solid knowledge of end-to-end project lifecycle, tools and elements of project management (Agile or scrum).

Ability to interact with diverse technical and non-technical groups.

Strong communication skills and facilitation abilities

Priorities management & time management skills

Highly open minded and proven knowledge transfer skills

Fluent English. French and/or German of benefit.

The position is located in Colmar, potential travelling 5-10%
Our Offer
We offer you the opportunity to join a successful international company and to work in a secure and progressive environment, which includes competitive salary and benefits, training and personal development.
Avons-nous suscité votre intérêt ? Si c’est le cas, nous serions ravis de recevoir votre candidature en ligne. Si vous avez des questions, veuillez contacter Virginie Loos à : virginie.loos@liebherr.com.
Liebherr - One Passion. Many Opportunities.
  • Une passion commune. Tant d’opportunités. L'entreprise
La société Liebherr-Mining Equipment Colmar SAS produit une gamme très diversifiée de pelles hydrauliques sur chenilles de 100 à 800 tonnes et godets jusqu’à 42m³.​​ Site
Liebherr-Mining Equipment Colmar SAS
49 Rue Frédéric Hartmann, CS 50038
68025 Colmar/Cedex
France (FR) Contact
Virginie Loos
virginie.loos@liebherr.com

*** Mention DataYoshi when applying ***

Offers you may like...

  • Onco360

    Data Engineer - Remote
    Waltham, MA 02451
  • Illuminate Education

    Data Engineer [remote]
    Remote
  • Liferay, Inc.

    Data Engineer
    Remote
  • UnitedHealth Group

    Senior Data Engineer - Telecommute
    Eden Prairie, MN 55346
  • Pinnacle Group

    Senior Data Engineer - Java / Scala / Machine Lear...
    Cupertino, CA