Data Engineer - Big Data

On behalf of our client in the Banking Sector, PROCOM is looking for a Data Engineer - Big Data.
Data Engineer - Big Data - Job Description

• Work with business stakeholders and cross-functional teams to understand data requirements and deliver scalable data solutions
• Design, develop, and maintain robust ETL processes to extract, transform, and load data from various sources into our data platform
• Build large-scale batch and event-driven data pipelines using cloud and on-premises hybrid data platform topology
• Work closely with data architects to review solutions and data models and ensure adherence to data platform architecture guidelines and engineering best practices
• Take ownership of end-to-end deliverables and ensures high quality software development while fulfilling all operational and functional requirements in a timely manner
• Implement and enforce data quality standards and best practices while collaborating with data governance teams to ensure compliance with data policies and regulations
• Optimize data integration workflows for performance and reliability
• Troubleshoot and resolve data integration and data processing issues
• Leverage best practices in continuous integration and delivery using DataOps pipelines
• Apply design-thinking and agile mindset in working with other engineers and business stakeholders to continuously experiment, iterate and deliver on new initiatives
• Stay informed about emerging technologies and trends in data engineering domain
• Lead, mentor, and inspire a team of data engineers to achieve high performance levels
  
  
  

Data Engineer - Big Data - Mandatory Skills

• Power BI implementation and configuration
• Experience with Microsoft Business Intelligence stack
• Solution architecture
• Implementation of other data warehousing, reporting and analytics solutions
• Metadata management
• Master data management
• Data governance
• Data analytics
  
  
  

Data Engineer - Big Data - Preferred Skills

• Experience with OpenShift, S3, Trino, Ranger and Hive
• Knowledge of creating dashboards using Prometheus and Grafana
• Knowledge about data science tools and libraries
  
  
  

Data Engineer - Big Data - Assignment Start Date ASAP – 12 months to start
Data Engineer - Big Data - Assignment Location Toronto, ON – Work Hybrid