Data Engineer

Company:
Location: Mechelen

*** Mention DataYoshi when applying ***

Project info:
For a customer in Mechelen, we're building an advanced supply chain analytics platform. End customers of this platform are multinationals in de process industry (mainly pharma and FMCG).
We build a virtual twin of the supply network, based on transactional ERP data. Additionally, advanced analytics and optimizations are performed on this virtual supply chain twin.
Needless to say that the amounts of data can be huge, so distributed data processing is an important factor.

Your role:
Take the leading role in the development of our big data pipeline, being able to wrap your head around complex logic and heavy transformations.
You work on an industrialized project with scheduled pipelines. Currently, the data pipeline handles data in large batches, but you'll assist in converting this to an event-driven data pipeline in the short/medium term future.

Required skills (3+ years experience):
Apache Spark

Data warehousing

SQL

Azure Fundamentals

Databricks

Scala/Java

Agile scrum

Optional skills:
Azure Data Factory/Synapse

Azure Event Hub

Docker/Kubernetes

Apache Kafka

Graph database technologies

Soft skills:
Good communicator

Analytical skills

Proactivity is important

Ability to engage with business

VACATURE REF.

Ik wens voor deze job in aanmerking te komen als:
Selecteer een functie...
Freelancer
Bediende
Selecteer een functie...

CV Uploaden

*** Mention DataYoshi when applying ***

Offers you may like...

  • Myticas Consulting

    BHJOB15656_16490 - Senior Data Engineer
    Remote
  • MarketDial

    Data Engineer
    Salt Lake City, UT 84101
  • Applied Research Associates, Inc

    Senior Data Engineer
    Fort Belvoir, VA 22060
  • PBT Group

    Cloud Data Engineer
    Johannesburg, Gauteng
  • PBT Group

    Data Engineer
    Johannesburg, Gauteng