SoftServe

Senior Big Data Engineer (AWS)

Job description

WE ARE

At SoftServe, we are advisors and providers who operate on the cutting edge of technology. With you, we set goals and reach them to grow better together, learning from both successes and mistakes. We are a team of thinkers and makers in more than 60 offices in 16 countries, true professionals and good people, who like what we do and do it well.

We are the Big Data and Analytics Center of Excellence, a data consulting and data engineering branch of SoftServe. 200 data engineers and architects build data and analytics end-to-end solutions: from strategy, through technical design and proof of concept, to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains across North America, EMEA, APAC, and LATAM.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like Snowflake, Confluent, Cloudera, Starburst, Collibra, Tableau, and others.

IF YOU ARE

  • Experienced working with AWS cloud
  • Proficient in modeling and querying data using SQL (Jinja templating)
  • Familiar with Python
  • Knowledgeable about data pipeline monitoring and support using tools such as data build tool (dbt), Databand, and Astronomer
  • Professional in query optimization of large datasets in Redshift and Databricks
  • Good at designing and maintaining production database systems
  • The one who analyses data customer requirements to leverage knowledge of data stores, their use cases, trade-offs, performance, and limitations
  • Showing expertise in real-time streaming via Kaa and Kinesis (nice to have)


AND YOU WANT TO

  • Contribute your experience to an autonomous team with end-to-end ownership of data architecture key components
  • Build pipelines that consume data from data lakes
  • Make pipelines efficient and optimize SQL
  • Work with high-loaded streaming environments
  • Dive into the cutting-edge technology stack, including services of major cloud providers not generally available yet
  • Engage with customers from diverse backgrounds, ranging from large global corporations to emerging crypto startups preparing to launch their first product
  • Be involved in the entire project lifecycle, from initial design and proof of concepts (PoCs) to minimum viable product (MVP) development and full-scale implementation


TOGETHER WE WILL

  • Support your technical and personal growth – we have a dedicated career plan for all roles in our company
  • Investigate new technologies, build internal prototypes, and share knowledge with the SoftServe Big Data community
  • Upskill with full access to Udemy learning courses
  • Pass professional certifications, encouraged and covered by the company
  • Assimilate best practices from experts while working in a team of top-notch engineers and architect
  • Collaborate with world-leading companies and attend professional events
  • Have a chance to address different business and technology challenges, engage in challenging projects and top-notch technologies, and drive multiple projects and initiatives as a part of the Center of Excellence






SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs

Data Scientist Senior Banque - Assurance H/F

Airbnb
October 25, 2024

Senior Business Data Analyst

ABOUT YOU
October 25, 2024