Data Engineer

Company:
Location: 02-508 Warszawa

*** Mention DataYoshi when applying ***

About us


GetinData is a Big Data solution provider who helps organizations with processing and analyzing a large amount of data. Company was founded in 2014 and collected a group of experienced and passionate Big Data experts with proven track of records. Currently our team consists of more than 80 Big Data experts and we still grow!

We mainly work with customers from Sweden, Switzerland and Poland. So far, we have helped 30+ of companies ranging from fast growing start-ups to large corporations in banking, pharmacy, telco, FMCG and media sectors. Besides projects we deliver practical Big Data Trainings.

We also have a big input in Big Data community in Poland by co-organizing the largest technical Big Data conference in Warsaw and meetups of Warsaw Data Tech Talks.


Currently, we are looking for a Data Engineer to our team.


About customer

A technology company from the US east coast (working hours by Central European Time). The customer is the global market leader in analyzing the value of digital advertising placements.


About project

The project aims to enhance the pipeline that deals with the measurement of video ads displayed on connected TV devices in terms of their viewability and fraud free-completions. The pipeline is a series of MapReduce jobs on EMR, orchestrated by Airflow. The goal is to improve its observability and over time to migrate the components to more modern technologies.


Responsibilities


  • Implementing an observability solution using Elastic stack.
  • Working on Airflow DAGs, including mentoring junior engineers in these field.
  • Unifying the pipeline with other data pipelines in the company.
  • Opportunity to work on rewriting some of the jobs.
  • Experience with the core part of technologies involved or similar.
  • Full understanding of big data processing concepts and distributed system.
  • Relevant work experience in software development in Python/Java/Scala/C/C++ and operations in production.
  • Good manners in communicating both in video meetings as well as asynchronously in English.
  • Good documentation skills.

Technologies: Python/ Java, Airflow, AWS (EMR, Glue, Cloudwatch, S3), MapReduce, Elastic stack

We offer
  • 100% remote work with autonomy, trust and transparency
  • Possibility to work from the office located in the heart of Warsaw (Old Mokotów, close to the Center) or from coworking in Gdańsk (Wrzeszcz)
  • Opportunity to learn and develop with the best Big Data specialists in Poland
  • Possibility of conducting workshops and training, if you are interested
  • All equipment needed for work
  • Medical care, sport card and other benefits
  • Salary: 120 - 180 PLN / h + VAT (depending on experience and skills)
  • Start: As soon as possible

*** Mention DataYoshi when applying ***

Offers you may like...

  • Myticas Consulting

    BHJOB15656_16490 - Senior Data Engineer
    Remote
  • MarketDial

    Data Engineer
    Salt Lake City, UT 84101
  • Applied Research Associates, Inc

    Senior Data Engineer
    Fort Belvoir, VA 22060
  • PBT Group

    Cloud Data Engineer
    Johannesburg, Gauteng
  • PBT Group

    Data Engineer
    Johannesburg, Gauteng