Individual to contribute to our transformation assuming accountability for data engineering lifecycle including research, proof of concepts, design, development, test, deployment, and maintenance of enterprise-scale data integration solutions leveraging Microsoft Azure PaaS offerings. Extensive experience working on Agile Scrum/DevOps teams employing latest CI/CD cloud-first best practices. Potential to become an SME on Platform capabilities (ingestion, storage, processing, and presentation patterns) and extend future-state strategic roadmap features.
What You’ll Do: Responsibilities
Provide technical direction to delivery scrum teams, extending patterns and establishing new ones as required.
Create and review technical designs of data integrations across various systems within enterprise and with external business partners over multiple transmission channels, data formats and processing patterns.
Extend/implement CICD pipelines and containerization strategy.
Responsible for ETL and SQL development using Domain Architecture and Interface based programming.
Build processes and diagnostics tools to troubleshoot, maintain and optimize solutions and respond to customer and production issues.
Skills Required:
Data engineer with in-depth knowledge of developing data-driven solutions using Azure App Services, Function Apps, API Service Management, Active Directory, Azure Storage, Data Factory, Databricks, RedisCache, SQL DB, Key Vault, Service Bus, Event Hub, and Application Insights.
Bachelor’s degree in computer science or related discipline; r Equivalent Work Experience.
5+ years of experience leveraging SQL & cloud data storage technologies specifically Microsoft SQL & Azure offerings.
5+ years of experience developing modern data ingestion tools/platforms/protocols (Kafka, APIs, EventHubs, ServiceBus etc.).
5+ Experience with data integration best practices (ETL/ELT patterns, Data Factory, Streams Analytics etc.).
5+ years of experience of ETL and SQL Programming.
2+ years of experience of C# and T-SQL.
3+ years of experience working with Microsoft Azure DevOps and CI/CD best practices.
3+ years of experience working in an Agile Scrum environment.
Experience with various data structure optimization techniques on a Data Streaming Platform.
Experience with Power BI or other similar data visualization tools.
Nice to Have:
Experience with Machine Learning and Artificial Intelligence based solutions.
Knowledge of data regulations and compliance policies (e.g., HIPAA).
Data Visualization experience, or strong affinity for leveraging data to help transform/optimize business functions.
Big Data experience.
IT healthcare experience.
IoT experience.
Accurate job description details are only on QConsulting.com/Jobs