Data Engineer

About project:

Overview Migration of 39 applications in Cloudera to AWS. enior developers

Estimated time of collaboration: 6-8 months or longer

Requirements:

• Experience in building data pipelines using spark (Scala or PySpark) on databricks
• Development experience in the Amazon Cloud Environment AWS (S3, EMR, Databricks, Amazon Redshift, Athena.)
• Experience in working with REST APIs
• Ability to perform data manipulations, load, extract from several sources of data into another schema.
• Ability to work with multiple file formats (JSON, xml, rdf,reports, etc.) and analyze data, if required for further processing
• Experience in DevOps is nice to have but knowledge about DevOps is required
• Understanding of core AWS services, and basic AWS architecture best practices.
• Snowflake experience will be a plus.
• Ability to understand requirements and changes to requirements

Our client offers:

• Become part of the ‘flag ship’ success story - We go through enormous growth!
• Based in the Benelux – we have offices in Amsterdam, Eindhoven and Brussels within an European and Global network
• Organization driven by technology – We have a tremendous technology backbone
• Open, ‘can do’ team spirit
• Environment where you can make your own ideas reality
• Drive your own career
• Market conform benefits