Lead Big Data Engineer (Python+Azure)

Job description


We are a big distributed team working with a customer, a giant in mining industry, located in Canada. Our customer is a diversified resource company committed to responsible mining and mineral development with business units focused on steelmaking coal, copper, zinc and energy. The client has expertise across a wide range of activities related to their area. The destination of all of our products is simplification, time and resource saving, safety of miners, and most importantly, reducing the environmental impact. And we rock!


A strong problem-solver with at least Upper-Intermediate English level, professional in
  • Azure Data Factory
  • Databricks or HD Insight or Synapse Analytics
  • Azure SQL DW (SQL Dedicated Pool)
  • Azure Blob Storage and Azure Data Lake
  • Azure SQL DB/Azure SQL MI/SQL Server
  • Azure Functions
  • Apache Spark
  • Event Hubs or similar (Kafka)
  • Azure Stream Analytics or similar (Flink, Storm)

What will make you stand out
  • Azure Cosmos DB
  • MPP systems: Azure SQL DW (Synapse), GCP BigQuery, Impala, AWS Redshift
  • ETL/ELT process design and implementation
  • Airflow
  • End-to-end architecture of Big data solutions

  • Microsoft Azure
  • Azure Databricks
  • Python and PySpark
  • New functionality and improving the existing one
  • Supporting migration from GCP to Azure platform

  • Accomplish great things
  • Process dynamic projects
  • Take part in internal and external events, as well as pass certifications
  • Care about your individual initiatives: we are open to them: just come and share your ideas
  • Design and build the architecture that scales the business and can be confidently relied on
  • Deliver real customer value while pursuing architecture quality in availability, scalability, interoperability, modifiability, performance, security, and testability

SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment regardless of race, color, religion, age, sex, nationality, disability, sexual orientation, gender identity and expression, veteran status, and other protected characteristics under applicable law. Let’s put your talents and experience in motion with SoftServe

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
HERE Technologies
March 29, 2023

Lead Big Data Engineer

March 29, 2023
March 29, 2023