Big Data Engineer

Job description

Big Data Engineer (Spark/Scala)

The Role

We are looking for experienced, innovative and highly motivated engineer who is capable of working collaboratively with the team to design, develop and support data engineering solutions. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to be able to solve complex engineering challenges and develop innovative solutions.

The Team

The Systems Engineering team is one of the fastest growing groups within Real-World Solutions (RWS) Technology division. We are enthusiastic about Agile software development, are one of the strongest advocates for DevOps and Test-Driven Development (TDD) in the group and believe strongly in enabling individuals to be their best by allowing them to be independent and be part of a self-organizing team.
The team deals with a wide variety of patient-level health care data, which is used by RWS Technology to solve complex healthcare problems for our clients ranging from supporting retrospective clinical studies to disease progression projections.
In your daily work, you will work with a team of Developers responsible for delivering an effective solution, with Data Analysts who will help you understand the domain and medical data, as well as with the QA engineers, which will ensure high standards of software quality.

Job Responsibilities:

  • Build pipelines for processing big amount of medical data
  • Participate in system design, development and maintenance
  • Work closely with the data analysts to identify and provide required data
  • Contribute to the definition and adoption of technical standards
  • Create comprehensive automated unit and integration tests


  • 3+ years of experience with Big Data Stream processing (Scala, Apache Spark)
  • Knowledge of SQL and transactional databases
  • Experience with one or more of: Apache Kafka, Apache Spark, Apache Flink, HDFS
  • Knowledge of the NoSQL database such as Hive, HBase, Cassandra, ElasticSearch or others
  • Bachelor’s Degree in Computer Science or another related field

Personal skills and behaviours:

  • Team player with solid collaboration and communication skills
  • Excellent analytical & troubleshooting skills
  • Focus on product and business value delivery
  • Familiarity with Agile methodologies

IQVIA is a leading global provider of advanced analytics, technology solutions and clinical research services to the life sciences industry. We believe in pushing the boundaries of human science and data science to make the biggest impact possible – to help our customers create a healthier world. Learn more at

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.