Data Engineer (Lakehouse)

Company:
Location: Zürich, ZH

*** Mention DataYoshi when applying ***

Data Engineer (Lakehouse)
Contract Role - 8 Months
Switzerland
Remote work is possible


Data Engineer (Lakehouse)

Contract Role - 8 Months

Switzerland

Remote work is possible

Our client, a well known Finance company, is currently looking for a Data Engineer (Lakehouse)to work on remote basis supporting its business in Switzerland.

Role:

The responsibility of the Data Engineer is to build a Lakehouse setup on Azure for two strategic projects in Finance IT and Risk Management IT.

Tasks:

  • Review existing solutions and their stages in the different data zones (bronze, silver, gold)
  • Suggest the architecture and implement the lakehouse according to the requirements of the two projects
  • Benchmark which load to do with either Databricks or Synapse
  • Evaluate optimal VM infrastructure for the respective Databricks workload
  • Implement productive data pipelines with the logic of existing Databricks notebooks
  • Implement optimal setup and tuning of Delta files and its handling using Python and SQL
  • Define and implement the interplay of ADF, Datalake, Databricks, Synapse up to Power BI

Required Skills:

  • Ability to work as part of a team, as well as work independently or with minimal direction
  • Hands-on experience in building a Lakehouse using Datalake, Databricks and Synapse on Azure is very important
  • +3 years in Data Engineering
  • Excellent written, presentation, and verbal communication skills
  • Collaborate with data architects, modelers and IT team members on project goals
  • Strong knowledge of Lakehouse components such as ADF, Datalake, Databricks, Synapse
  • Good knowledge of Power BI, SQL, Python

Key Skills

Microsoft Azure / Synapse / Python/ SQL/ Data Engineering /DataBricks / Datalake

*** Mention DataYoshi when applying ***

Offers you may like...

  • Grubhub Holdings, Inc.

    Senior Data Engineer
    New York, NY 10018
  • Splunk

    Data Engineer, DevOps - Remote OK
    Sun Prairie, WI 53590
  • Cognizant Technology Solutions

    Senior Data Engineer (Remote) - Advanced Technolog...
    Chicago, IL 60601
  • Lessonly

    Senior Data Engineer
    Indianapolis, IN 46202
  • Numerator

    Sr. Data Engineer
    Chicago, IL 60606