Data Engineer

Job description

You will join a small team of experienced backend/data engineers to help us improve/rebuild the
infrastructure. From getting it from sources, transforming it, and finally providing it to consumers,
you will be challenged to find the best solutions to process the diverse set of data in an
ever-growing environmentRESPONSIBILITIES Design and develop a distributed data processing system built upon AWS
  • Analyze performance and scaling of existing solutions in response to increased load
  • Develop and improve architecture, as well as selecting optimal technologies and
  • Provide end to end data deployment from inception to consumption
  • Close work with DS engineers provide data for the ML components
Develop best practices for data integration and streamingRequired skills 2-3 years of relevant experience as a Data Engineer or Backend Engineer
  • Deep knowledge of data structures and algorithms
  • Good understanding of SQL and NoSQL databases, design, and methods for efficiently
retrieving data
  • Strong knowledge of Java and Scala
  • Understanding of Big Data technologies and solutions (Hadoop, Spark, etc)
  • Experience with streaming services (Apache Kafka, Kinesis)
  • Experience with Clouds (AWS preferred)IT’S AWESOME BUT NOT A MUST
  • Infrastructure as a code (Terraform)
  • Container technologies (Docker and Kubernetes)
  • Workflow engines (Apache Airflow or similar)
  • Python

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.