Data Engineer - IoT

Data Engineer - IoT

Xcede have partnered with a manufacturer of fibre-optic products, with offices across Europe, Middle-East, Africa and the Americas.

This opportunity is working on a hybrid model, with 2/3 days a week in office near Stuttgart.

The working environment is English and all applicants must be able to speak fluently.

Your Responsibilities

* You will work on the development of our hybrid (Cloud and Edge) IoT data infrastructure (Data Lake and MLOps).

* You will work on building a robust and scalable data catalogue to effectively manage metadata. This includes understanding and implementing best practices for data governance, management, and accessibility.

* You will work on a highly efficient storage layer to handle large amounts of sensor data (petabytes). The focus is on ensuring data integrity, speed, and scalability.

* In close collaboration with relevant teams and stakeholders, including Data Science, Operations and Business, you will perform the necessary requirements engineering.

* In close collaboration with other Data Engineers, ML Engineers, and Software Engineers, you will translate our business challenges into scalable data architectures.

* As an expert in our Data Engineering team, you will maintain your knowledge of current technologies, future trends and innovative methods through continuous training, cross-industry networking, and conference attendance.

Your Profile

* You have at least 2 years of professional experience in data engineering, ideally in the field of big data or IoT

* You have excellent knowledge of state-of-the-art storage technologies and their productive use (no SQL, time series databases, document stores, graph databases, etc.).

* You have sound programming skills in development with Python or other programming languages

* Experience with containerization (Docker and Kubernetes)

* In-depth knowledge of AI workloads and MLOps.

* Ideally, you have good knowledge of at least one majorcloud platform (AWS, GCP or Azure) and understand how to use the services optimally.

* You are familiar with stream processing technologies(Apache Flink, Spark, Storm, or Kafka).

For more information please apply directly, or send your CV to Steven.Waterson@xcede.de

Our client is not able to accept overseas applicants for this position.

Desired Skills and Experience

Docker
Kubernetes
Python
AI workloads
MLOps
Apache Flink, Spark, Storm, or Kafka
AWS, GCP or Azure