Data Engineer

Company:
Location: Gdańsk, pomorskie

*** Mention DataYoshi when applying ***

Numer referencyjny: DE/WH
lokalizacja
pomorskie / Gdańsk
kategoria
Specjalista ds. baz danych

About project:

Overview Migration of 39 applications in Cloudera to AWS. enior developers

Estimated time of collaboration: 6-8 months or longer

Requirements:

  • Experience in building data pipelines using spark (Scala or PySpark) on databricks
  • Development experience in the Amazon Cloud Environment AWS (S3, EMR, Databricks, Amazon Redshift, Athena.)
  • Experience in working with REST APIs
  • Ability to perform data manipulations, load, extract from several sources of data into another schema.
  • Ability to work with multiple file formats (JSON, xml, rdf,reports, etc.) and analyze data, if required for further processing
  • Experience in DevOps is nice to have but knowledge about DevOps is required
  • Understanding of core AWS services, and basic AWS architecture best practices.
  • Snowflake experience will be a plus.
  • Ability to understand requirements and changes to requirements

Our client offers:

  • Become part of the ‘flag ship’ success story - We go through enormous growth!
  • Based in the Benelux – we have offices in Amsterdam, Eindhoven and Brussels within an European and Global network
  • Organization driven by technology – We have a tremendous technology backbone
  • Open, ‘can do’ team spirit
  • Environment where you can make your own ideas reality
  • Drive your own career
  • Market conform benefits

*** Mention DataYoshi when applying ***

Offers you may like...

  • Glassdoor

    Data Engineer (Remote)
    Washington, DC
  • Homethrive

    Data Engineer
    Remote
  • YouGov

    Data Engineer
    New York, NY
  • drc

    Senior Full Stack Developer / Data Engineer - REMO...
    Maple Grove, MN
  • Relatus

    Senior Data Engineer
    Remote