Job description
Position Overview: We are looking for a Data Engineer to join our team and help us develop, maintain, and optimize ETL processes. This position requires a critical thinker who can turn raw data into meaningful insights that can be utilized to support business decisions.
Key Responsibilities: • Design, develop, and maintain ETL processes using Databricks, Python, and SQL • Perform data profiling, analyze data, and identify patterns • Develop pipelines for data movement from Azure to Snowflake • Integrate data from multiple disparate sources • Develop Azure Data Factory ETL data pipelines and DBT jobs • Ensure data accuracy and quality • Collaborate with stakeholders to provide insights and recommendations
Qualifications: • Bachelors degree in Computer Science, Engineering, or related field • 3+ years of experience in an ETL development role • Proficient knowledge of Databricks, Python, and SQL • Experience with Azure, Snowflake, Azure Data Factory, and DBT is a plus • Strong analytical and problem-solving skills • Excellent communication skills
Azure Data Bricks, Azure Data Factory, Azure Datalake, Python, SQL, PowerBI. Strong databasee background with Oracle and SQL Server are also important. Would like someone with healthcare background preferably in provider data management
