Sr. Data Engineer

Job Summary

In collaboration with the Manager, Data Operations, the Senior Data Engineer is responsible for the data, architecture, and model of our Enterprise Data & Analytics environment. This role will maintain the current data warehouse solution and be an active participant in decommissioning legacy solutions.

Responsibilities

• Plan, coordinate, develop and support data model development, including architecting table structure, building ETL process, documentation, and long-term preparedness.
• Analyze, design, develop, implement, and maintain technical solutions in AWS using data ETL technologies, including Amazon S3, AWS Glue Studio, AWS Glue Data Catalog, Lake Formation, Glue crawlers, AWS Athena, and Snowflake.
• Maintain the current data warehouse solution and be an active participant in decommissioning legacy solutions.
• Develop cross-validation rules to ensure data accuracy.
• Define technical approach documents (define calculated logic, process flow).
• Meet business requirements of the projects as new data sources are added.
• Provide production support for existing data pipelines.
• Document steps needed to migrate database objects between various environments, including Development, UAT, Staging, and Production.
• Provide regular project updates to shared team resources and management as needed.
• Communicate issues, risks, and concerns proactively to manage and engage colleagues while working in a hybrid Agile/Scrum process.
• Document pipelines thoroughly to allow peers to assist with support as needed.
• Provide technical assistance and task delegation to a flexible team of staff engineers, consultants, and interns in close coordination with the team Manager and Data Architect.
• Nights, weekends, and non-regular hours may be required to deploy and make ready solutions that need support and collaboration from resources.

Skills And Qualifications

• Bachelor's degree in computer science or related field and five plus years’ experience in data engineering and data warehouse technologies with a focus on the AWS platform in the past five years to present.
• A minimum of 5 + years’ experience in progressive data engineering roles.
• Expert knowledge in SQL, ETL architecture, data architecture and BI architecture.
• 5+ years’ experience in Python for data and analytics.
• Experience with Amazon S3, AWS Glue Studio, AWS Glue Data Catalog, Lake Formation, Glue crawlers, AWS Athena, and Snowflake or could data warehouse.
• Knowledge of best practices in enterprise-wide database implementation, availability, and security configuration.

Qualifications/Experience Preferred:

• Experience in migrating from Informatica to AWS.
• Informatica, POWER BI, and Alteryx experience.
• Previous experience with Snowflake implementation.
• Knowledge using AWS EMR and Sagemaker.
• RESTful API experience.
• Data pipeline experience (e.g., Kafka).
• Statistical software experience (e.g., JMP, Minitab).

S agen is committed to creating a diverse and inclusive work culture that closely matches the diversity of our customers. We encourage applications from all backgrounds and abilities to ensure we get the best, most creative and diverse talent across our business.

Sagen will provide accommodations to applicants with disabilities throughout the selection process to meet their individual needs.

As an Employer Partner of the Canadian Center for Diversity and Inclusion and a member of the Black North Initiative, Sagen encourages you to apply and join a fantastic organization.