Senior Big Data Engineer

Location: United States

*** Mention DataYoshi when applying ***

EPAM is committed to providing our global team of more than 41,150 EPAMers with inspiring careers from day one. EPAMers think creatively and lead with passion and honesty. Our people are the source of our success. We value collaboration, work in partnership with our customers, and strive for the highest standards of excellence. In today’s market conditions, we’re supporting operations for hundreds of clients around the world remotely. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.


Currently, we are looking for an experienced Senior Big Data Engineer to make the team even stronger.

You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Senior Big Data Engineer. Scroll down to learn more about the position’s responsibilities and requirements.

Location: Remote. Relocation to Pittsburgh, PA will be needed after lockdown.

REQ# 212600848

What You’ll Do

  • We are looking for a Big Data Engineer who will work on the collecting, storing, processing, and analyzing of large sets of data
  • The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them
  • You will also be responsible for integrating them with the architecture used across the company


  • Proficient understanding of distributed computing principles
  • Management of Hadoop cluster (Cloudera preferred), with all included services
  • Ability to solve any ongoing issues with operating the cluster
  • Proficiency with Hadoop v2, MapReduce, HDFS, Sqoop
  • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Experience with Spark
  • Experience with integration of data from multiple data sources such as MsSQL Server, Oracle
  • Good understanding of SQL queries, joins, stored procedures, relational schemas
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB (preferred)
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Experience with Cloudera

Nice to have

  • Experience in Financial Services domain a big plus but not required

What We Offer

  • Medical, Dental and Vision Insurance (Subsidized)
  • Health Savings Account
  • Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
  • Short-Term and Long-Term Disability (Company Provided)
  • Life and AD&D Insurance (Company Provided)
  • Employee Assistance Program
  • Unlimited access to LinkedIn learning solutions
  • Matched 401(k) Retirement Savings Plan
  • Paid Time Off
  • Legal Plan and Identity Theft Protection
  • Accident Insurance
  • Employee Discounts
  • Pet Insurance

*** Mention DataYoshi when applying ***

Offers you may like...

  • Zurich Insurance

    Senior Business & Data Analyst (w/m/d) 80 - 100 %
    Zürich, ZH
  • Databricks

    Senior Big Data Engineer
  • Godel

    Middle / Senior Big Data Engineer (AWS)
    Łódź, łódzkie
  • Cosi hospitality group

    Senior Backend/ -Data Engineer (m/f/d)
    10117 Berlin
  • DISH

    Senior Big Data Engineer
    Englewood, CO 80112