Senior Data Engineer

Company:
Location: Düsseldorf

*** Mention DataYoshi when applying ***

SENIOR DATA ENGINEER

DUSSELDORF, GERMANY

85.000 - 95.000 EUR

THE COMPANY

Our client is a fast-growing retail automation platform which is searching for a proactive and flexible data engineer to bring a modern tech-stack to their team. You will be redefining the vision of the company's data science platform and in charge of the continuous development of their digital infrastructure.

YOUR TASKS

  • You are the main point person for managing, optimizing, overseeing and monitoring data retrieval, storage and distribution throughout the organization.
  • You will be developing, constructing, testing and maintaining architectures, such as databases and large-scale processing systems, using Databricks as a platform.
  • Actively collaborate with engineering, quality engineering and product management to architect and build systems/features that are highly available, reliable and secure.
  • Your aim will be to improve data reliability, efficiency, and quality by using structured processes to support the Data Science code.
  • Use Kafka to define contracts between their web application and data platform, with the implementation of Avro schema definitions.
  • Operationalize data science models with MLflow for production use on the data platform, where retailers receive forecasts for future demand.

YOUR PROFILE

  • You have a strong background in database engineering with a focus on database architecture, production automation, monitoring systems and operations within Databricks.
  • You bring a completed degree of university or technical college education in informatics, data science/engineering, mathematics or a comparable qualification
  • You have extensive hands-on experience with the Hadoop Big Data ecosystem (Spark, Hive/Impala, HBase, Yarn), and Data Lake, and you are a pro with stacks such as AWS or GCP, Java / Scala / Python / R.
  • You have worked a great deal with microservice architectures and data streaming systems like Kafka.
  • Demonstrated success in interacting and providing technical capabilities to several clients in non-technical communications methods.
  • Experienced in project planning, management & implementation along with root cause analysis and quality management.

*** Mention DataYoshi when applying ***

Offers you may like...

  • ActiveCampaign

    Senior Data Engineer
    Dublin, County Dublin
  • Brainbridge

    Senior Data Developer / Data Engineer
    Gosselies
  • AC3

    URGENT! Senior Data Engineer
    Melbourne VIC
  • First Talent

    Senior Data Engineer (Remote)
    Barcelona, Barcelona provincia
  • Global Savings Group

    Senior Data Engineer (m/f/d)
    28013 Madrid, Madrid provincia