Data Engineer

Company:
Location: Laakdal

*** Mention DataYoshi when applying ***

Data Engineer

Part of the team in charge of building a data processing product (data pipeline), adopted across Nike organization, you will work closely with other Data, UI and DevOps engineers, with the Scrum Master, Product Owner, Architects and Engineering Manager, to evolve the product, but also optimize its release cycle and improve user experience.

Technology stack: AWS, PySpark, Pytest, Hive, DynamoDB, microservices, Jenkins, Docker, Kubernetes.

Responsibilities


  • Design, implement, test and deliver robust, scalable and reusable data processing and ETL solutions
  • Automate data extraction, transformation and provisioning, irrespective of type of source and target
  • Participate to testing activities (create own test cases, manage test data, set up environments, etc., as no test engineers present in the team)
  • Drive collaborative reviews of design, code, test cases and dataset implementation performed by other data engineers in support of maintaining data engineering standards
  • Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
  • Mentor and develop other data engineers in adopting best practices
  • Represent the team as technical ambassador
  • Collaborates with the Data Engineering community to establish standards and best practices

Skills

Technical skills:

  • Last 3 years in data engineering (Python is a must)
  • Experienced in structured & unstructured data, data lakes
  • Great experience in Python Spark (have worked in the last 3 years)
  • Good knowledge of SQL (preferably Hive) and No-SQL (preferably Dynamo DB)
  • Good knowledge of scheduling and orchestration
  • Good knowledge of cloud platform tools (preferably Amazon Web Services – AWS)
  • Average knowledge of API & microservices in Python
  • Good GitHub knowledge
  • Ability to review complex big data architecture designs
  • Average knowledge of DevOps (Kubernetes, Docker) and good knowledge of CI/CD (Jenkins)
  • Good testing experience (unit test, component test, system test) with some of the most common tools in the market (PyTest, Nose, Behave, etc.)

Soft skills:

  • Good communication skills in English
  • Proactive and autonomous
  • Experience working in multinational and multicultural environments
  • Able to influence and interface with other teams and stakeholders (business or technical)
  • Agile Mindset, preferably with experience working in Scrum

*** Mention DataYoshi when applying ***

Offers you may like...

  • SmartBLKTrade Limited (SBT)

    Research Data Scientist / Big Data Engineer, AI De...
    Southern District, Hong Kong Island
  • Peoplebank

    Data Engineer / Data Scientist
    Melbourne VIC
  • IBM

    Data Scientist / Data Engineer - MVP Build Team
    London
  • Guidehouse

    Data Engineer - Senior Consultant
    Washington, DC 20006
  • Liberty Mutual Insurance

    Principal Data Engineer
    Boston, MA 02116