Azure Data Engineer

The role will leverage & enhance existing technologies in the area Data and analytics Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services.

The role will be responsible to develop and support IT products and solutions using these technologies and deploy them for business users

Technical Requirements

• 5 to 8 Years of IT & Azure Data engineering technologies experience
• Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services
• Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet.
• Experience in creating ADF Pipelines to source and process data sets.
• Experience in creating Databricks notebooks to cleanse, transform and enrich data sets.
• Development experience in orchestration of pipelines
• Good understanding about SQL, Databases, Datawarehouse systems preferably Teradata
• Experience in deployment and monitoring techniques.
• Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources.
• Experience in handling operations/Integration with source repository
• Must have good knowledge on Datawarehouse concepts and Datawarehouse modelling.
• Working knowledge of SNOW including resolving incidents, handling Change requests /Service requests, reporting on metrics to provide insights.
• Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data.

Non-technical Requirement

• Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data.
• Think and work agile, from estimation to development, including testing, continuous integration, and deployment.
• Manage numerous project tasks concurrently and strategically, prioritizing when necessary.
• Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals.

Nice To Have Skill Sets

• Business Intelligence tools (preferred –Power BI)
• DP-203 Certified.