Azure Data Engineer

Must Have:

• 4-8 years of experience in IT, 4+ years' experience working on various Azure services along with experience in Data Warehousing /Data Lake, ETL and BI solutions.
• Working with business and stakeholders on requirements and convert into Technical solutions.
• Experience in implementation to meet stated requirements for metadata management, operational data stores and Extract Transform Load environments.
• Proven experience in MS Azure data services – ADF V2, ADLS Gen2, Azure Databricks, Azure Function, SQL DW(Azure Synapse), Azure logic Apps
• Good Knowledge on
• Azure Databricks

Ø Experience in Big Data components such as Kafka, Spark SQL, Data frames, HIVE DB etc implemented using Azure Data Bricks would be preferred
Ø Azure Databricks integration with other services
Ø Read and write data in Azure Databricks

• Azure Data Factory:

Ø Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime
Ø Hands-on knowledge of ADF activities (such as Copy, SP, lkp etc.) and Dataflows
Ø ADF data Ingestion and Integration with other services

• Azure Function

Ø Creating Azure functions with Python/C#/JavaScript

• Knowledge Azure Synapse and Azure SQL Database
• Experience in troubleshooting the problems across infrastructure, platform, and application domain
• Perform resource allocation and maintain the proper utilization
• Act like a primary contact for Customer queries and concerns

Nice to Have:

• Azure Synapse Analytics with and without using PolyBase