Data Engineer

Company:
Location: Warszawa, mazowieckie

*** Mention DataYoshi when applying ***

Diverse CG is a modern technology company, gathering in its ranks IT related professionals. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position:

Data Engineer

Responsibilities:

  • Integrate third party provider data (via Files, APIs, Events…)
  • Upgrade vendor components through their major and minor patches
  • Maintain connectivity with internal customer applications sourcing their data referential information via our WebServices, APIs, ETLs
  • Reduce platform complexity by reducing point to point connections and favoring API connectivity
  • Work in an agile environment directly in contact with our data mangement counterparts and SMEs in France
  • Build tools and services to reduce manual work carried out by either our support team or our Data Management team
  • Build Data quality controls to monitor all our third-party data and data sent to our customers
  • Integrate and maintain data referentials in our Dataplatform
  • Build and maintain CI/CD Pipelines, shared libraries (data pipeline development, data quality, data lineage) and shared services (REST API, data viz, monitoring, scheduling)
  • Design and maintain APIs

Requirements:

  • Scripting: Shell/bash, Powershell
  • Scheduling management - Control M API (ideally)
  • Experience working with data of various formats (np. Avro, Parquet, JSON, CSV)
  • SQL expertise, knowledge of Microsoft SQL
  • very good knowledge of C#
  • .NET Webservices
  • ETL management
  • API building/maintenance
  • Git CD/CI
  • Azure Dev Ops
  • Informatica - IDQ
  • Financial knowledge around MDM
  • Neoxam NDH would be fantastic
  • Spark/Scala or Python
  • Kubernetees, Docker, Kafka

Offer:

  • Private medical care
  • Constant support of dedicated consultant
  • Team-building events organised by DCG
  • Competitive salary adequate to experience and skills
Aplikuj online

*** Mention DataYoshi when applying ***

Offers you may like...

  • The Upside Travel Company, LLC

    Senior Data Engineer
    Remote
  • PPL Corporation

    Senior Data Engineer- Remote
    Allentown, PA
  • Artemis Consulting Inc

    Senior AWS Cloud Data Engineer
    Washington, DC 20001
  • Illuminate Education

    Data Engineer [remote]
    Minneapolis, MN 55402
  • Atomic

    Data Engineer
    Remote