EPAM Systems

Big Data Engineer (Spark Developer)

Job description

Are you passionate about Spark, Big Data and cloud technologies? Do you have a curious nature, always interested in how to innovate? Do you enjoy working closely in an embedded teams in an agile manner?

If this sounds like you, then you have an opportunity to join a highly motivated and experienced team with in-depth knowledge about Big Data and Data Analytics, building models and algorithms. EPAM is looking for a Big Data Engineer to support our world-leading Customer in building a best-of-breed data analytics capability for its payments flow.

As part of this role, you'd be working within a wider team that operates as a well-organized unit comprising developers, QAs, analysts, and data scientists all working together based on Agile principles.

What You’ll Do

  • Design, develop and optimize Spark jobs used within a cutting-edge analytics and reporting system that is used to support the Client’s critical liquidity management functions
  • Work closely in an embedded team with other software developers and data scientists, building out the capabilities the data scientists need to build best-in-class distributed compute data models and algorithms to understand and optimize the banks liquidity situation
  • Have a passion to learn and leverage all the Azure based tools and technologies available to us
  • Support your team, data scientists and end users to with how they can leverage your Spark knowledge to build and optimize their own Spark jobs

What You Have

  • Strong, demonstrable Python and Spark experience
  • Experience with Data Science and ML libraries is highly desirable
  • Demonstrable knowledge of good software design including writing and maintaining efficient Spark jobs. (Hence knowledge of Scala would also be advantageous)
  • Azure experience is highly desirable
  • Docker / K8 / container experience is highly desirable
  • Knowledge of Databricks or comparable platforms
  • Comfortable working in an Agile manner and with CI/CD tools (GitLab in our case)
  • Have strong analytical and design skills and be structured and systematic in their approach
  • Financial background is a plus
  • Curious and analytical, Good problem solver and strong communicator
  • Team player, Self-motivated and solution oriented
  • Fluent in English

We offer

  • Competitive compensation depending on experience and skills
  • Knowledge-sharing across EPAM's global Tech Communities
  • Unlimited access to LinkedIn learning solutions
  • Relocation support as per EPAM relocation policies
  • EPAM Community with regular corporate and social events
  • Career growth, performance and compensation reviews
  • EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)


  • Please note that any offers will be subject to appropriate background checks
  • We do not accept CVs from recruiting or staffing agencies
  • Due to the Swiss labour legislation we can only accept applicants who have a valid right to work in Switzerland

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs

Big Data Analyst

December 8, 2021

Principal-Big Data Engineer