Data Engineer

Job Description

Role: Azure Data Engineer

Experience: 3-5 Years

Skill Set

Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory

Roles And Responsibilities

Should have programming skills with the ability to write optimized and reusable high-quality code.

Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, SQL.

Optimize SQL queries for efficient data extraction and manipulation.

Demonstrate expertise in Databricks including workflow management and data exploration.

Collaborate with cross functional teams to understand the business requirements.

Implement best practices for data pipelines optimization, ETL, and query performance.

Create and maintain documentations for data pipelines and workflows.

Troubleshoot and resolve issues in data pipelines, ensuring minimal downtime.

Contact:- shanawaz@colanonline.com