Data Engineer

Piper Companies is actively seeking a Data Engineer to remotely join a start up health software and technology company headquartered in Durham, NC. The Data Engineer will be responsible for helping to intake and work with the large amount of data coming in.

Responsibilities of the Data Engineer:

• Explore and Map EHR datasets to common data models
• Work towards creating cutting-edge distributed analytics platform that can aggregate data from multiple different sources
• Build data pipelines that will empower researchers to conduct clinical trials and disease surveillance in real-time

Qualifications of the Data Engineer:

• 3+ years of hands on Apache Spark experience
• 3+ years of experience with Scala/ Java and or Python
• 2+ years of cloud expereince (AWS or GCP)
• Experience building data pipelines and working directly with Clarity database
• Kubernetes, NoSQL data stores, machine learning experience is a huge plus

Compensation of the Data Engineer:

• Salary: 140,000 - 170,000
• Benefits: Medical, Dental, Vision, unlimited PTO

Keywords: data engineer, data architect, apache spark, spark, scala, java, python, aws, gcp, google cloud platform, clarity, kubernetes, noSQL, data stores, machine learning, kafka, rabbitMQ, redis pub/sub