Billennium

Senior Data Engineer

Job description

For our American customer we are looking for an exceptional Senior Data Engineer to help define and build their next generation data platform on top of Google Cloud, guiding its direction and integration within the company. This platform will support an internal analytics and personalization needs, while enabling future business opportunities.


Your role


  • understanding the data sources and map them into respective domains;
  • building projects using complex business algorithms and load them in the data warehouse;
  • presenting a schema management system design at an Engineering-wide architecture review;
  • building new data pipelines using DataFlow and DataForm;
  • coding data fills in python against Google Cloud Storage and BigQuery;
  • investigating, deployment and implementation a caching solution for enabling real-time joins of big data sets;
  • development a data quality validation framework used for both testing and real time production data;
  • designing tools enabling easy-to-use workflows for internal teams using the data platform.


Your skills & experience


  • 7+ years of experience designing and implementing large scale software;
  • 4+ years of experience working with Big Data technologies like Apache Beam,DataFlow, BigQuery, Kafka, Airflow and Spark;
  • experience designing a real-time Big Data platform;
  • experience deploying and managing Big Data infrastructure;
  • strong coding ability in an object oriented language (preferably Scala, Python, Java);
  • excellent team player with strong communication skills (verbal and written);
  • enthusiastic about collaborative problem solving;
  • bachelor’s degree or better in Computer Science;
  • Polish citizenship;
  • nice to have: experience with Streamsets, Google BigQuery, Apache NiFi, Looker, Pipeline monitoring tools, Strong SQL and data modelling skills.


Our offer


  • ability to work remotely or in one of our offices;
  • mature, international project environment - challenging and rewarding projects;
  • access to training and certificate courses;
  • free access to an advanced training platform (Udemy for Business);
  • flexible work schedule and hours;
  • access to private medical service, life insurance, and Multisport card;
  • awesome company events and parties.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
PwC Argentina
December 6, 2023

Semi-Senior Data Analyst - Rosario

CGI
December 6, 2023
Plenty of Fish
December 6, 2023