Data Engineer: Machine Vision: Azure/AWS

Location: Rotterdam

*** Mention DataYoshi when applying ***

A World Leading Global Energy Company has an exciting contract opportunity for a Data Engineer to join a part of the business that drives digital innovation opportunities and delivers new capabilities, creating, deploying and supporting cutting-edge IT solutions.

About the Role:
The Data Engineering team is accountable to develop, deploy and sustain leading edge marketing and advanced analytics platform capabilities for the business, providing a truly leading edge capability which delivers sustainable competitive advantage and business value..

As a Data Engineer, you will work alongside the Data Science Lead and will be responsible to support the development of cutting edge algorithms using the latest big data and machine learning technology. You will ingest structured, semi-structured and unstructured batch- and Real Time data from numerous data sources into the newly yet to be designed data platform. As a Data Engineer, you will use the latest auto deployment, testing and monitoring techniques and work closely with the Solution Architect and Data Architect to design the big data platform.

Purpose and Accountabilities:
  • Work together with the Solution and Data Architect to design the next generation big data platform to support the digital marketing platform
  • Design and implement a new big data solution which supports high amounts- and velocity of data, supports future growth, use latest big data technologies/techniques, is cloud supported and in-line with the businesses strategies
  • Design and implement modern data pipelines to extract, clean and process data in batch and Real Time from different data sources
  • Use the latest development, testing and deployment techniques to quickly deploy new releases to eg deploy new data pipelines and add data sources
Skills & Requirements:
  • Bachelor or master degree in information technology, computer science, data management business administration or a related discipline
Preferred Experience:
  • 5+ years' experience with big data platforms; working with large data sets, large amounts of data in motion and numerous big data technologies
  • Preferable experience with data science scenarios and machine learning frameworks (Caffe, Theano, Tensorflow, MXnet, CNTK)
  • Knowledge in Machine Vision will be advantageous
  • Auto software deployment technologies (eg Jenkins, Docker, Git)
  • Experience with Cloud (AWS, Microsoft Azure)
  • Hadoop/Spark-based technologies (eg Spark, MapReduce, Hive and Pig)
  • NoSQL-based technologies (eg Cassandra, HBASE, MongoDB)
  • Awareness of Agile Framework and its tools such as Visual Studio Team Services (VSTS)
  • Data pipelining-based technologies (eg KAFKA, StreamSets, Flume Talend, ADFv2)
Core Experiences:
  • Highly analytical, troubleshooting and problem-solving skills
  • Experience with data Architecture and design techniques (local/abstract)
  • Experience with API techniques/developments
  • Experience with data transformation/blending technology (eg Alteryx is preferred)
  • Experience with Spark based
  • SQL-based technologies (eg MSSQL, MySQL, PostgreSQL)
  • Source Code Control (eg Git, Subversion)
  • Open Source Frameworks (Apache Spark, Hadoop etc.)
  • Agile Project Delivery techniques (eg SCRUM)
  • Strong design and coding skills (eg Python, Scala, JavaScript)

*** Mention DataYoshi when applying ***

Offers you may like...

  • Glassdoor

    Data Engineer (Remote)
    Washington, DC
  • Homethrive

    Data Engineer
  • YouGov

    Data Engineer
    New York, NY
  • drc

    Senior Full Stack Developer / Data Engineer - REMO...
    Maple Grove, MN
  • Relatus

    Senior Data Engineer