You will join a small team of experienced backend/data engineers to help us improve/rebuild the infrastructure. From getting it from sources, transforming it, and finally providing it to consumers, you will be challenged to find the best solutions to process the diverse set of data in an ever-growing environmentRESPONSIBILITIES Design and develop a distributed data processing system built upon AWS
Analyze performance and scaling of existing solutions in response to increased load
Develop and improve architecture, as well as selecting optimal technologies and
methodologies
Provide end to end data deployment from inception to consumption
Close work with DS engineers provide data for the ML components
Develop best practices for data integration and streamingRequired skills 2-3 years of relevant experience as a Data Engineer or Backend Engineer
Deep knowledge of data structures and algorithms
Good understanding of SQL and NoSQL databases, design, and methods for efficiently
retrieving data
Strong knowledge of Java and Scala
Understanding of Big Data technologies and solutions (Hadoop, Spark, etc)
Experience with streaming services (Apache Kafka, Kinesis)
Experience with Clouds (AWS preferred)IT’S AWESOME BUT NOT A MUST