SoftServe

Lead Big Data Engineer (COE)

Job description

WE ARE

Big Data & Analytics Center of Excellence, data consulting, and data engineering branch of SoftServe. Starting as a group of 3 enthusiasts back in 2013, almost 200 Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others.

Together with the SEI and Carnegie Mellon University, we adapted ADD and ATAM architecture design methodologies to Big Data needs and invented the Smart Decisions game to promote architecture design best practices in AI and Big Data.

YOU ARE

A Software Engineer focused on data pipeline creation and comfortable with batch processing, streaming processing, or both and used to leading a team or considering yourself ready to do it.

You also are experienced in
  • SQL and Python or Scala programming languages (at least one)
  • Data solutions development in Azure
  • Apache Spark, Databricks
  • Azure Data Factory, ADLS Gen2, Azure SQL, Azure DevOps, and others
  • Apache Kafka or Azure Event Hub, Azure IoT Hub, Azure Stream Analytics
  • SQL Server, Azure Synapse, or Snowflake
  • Breaking down customer requirements into development tasks, estimation, leading a team of fellow data engineers

YOU WANT TO WORK WITH
  • The team of data-focused engineers who learn, improve, and share the knowledge day by day
  • The cutting-edge technology stack, including major cloud providers' services that are not generally available yet
  • Customers from all over the world, from huge global corporations to crypto startups that are about to launch their first product
  • Entire project lifecycle, from initial design through PoCs and MVP up to the full-scale implementation

TOGETHER WE WILL
  • Help customers meet the goals of their analytics initiatives
  • Design, implement or migrate data platforms and ETL pipelines implemented as a code
  • Support your technical and personal growth–we have a dedicated career plan for all roles in our company
  • Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Big Data Community

Enjoy such benefits
  • Unlimited upskill opportunities with full access to Udemy learning courses
  • Professional certifications, encouraged and covered by the company
  • Assimilating best practices from experts, working in a team of top-notch Architects
  • Working with world-leading companies
  • Chance to address different business and technology challenges, drive multiple projects and initiatives as being a part of the Center of Excellence
  • Attending and giving speeches at international events
  • Variety of projects to join

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.