Data Engineer - Parquet RFP 18301

Our client, a leader in the healthcare industry, is looking for a Data Engineer to assist with converting SAS datasets to Parquet.

The client is ndergoing a transformational project to move to an open-source analytical environment – using R and Python. A component of this project is to convert CIHI’s analytical data assets from SAS database format to Parquet.

Advantages

• 6 month contract that can be done 100% remotely and has a strong potential to renew
  
  

Responsibilities

Services:

• Converts historical data from SAS database to Parquet.
• Works closely with internal teams to develop and transition ongoing production process of analytical assets (currently coded in SAS and stored as SAS datasets) to be coded using Python (leveraging Pyspark) and stored in Parquet.
• Recommends improvements and enhancements to conversion processes and ongoing production of analytical assets.
• Prepares documentation required related to the results of the conversion (e.g. differences in converted data that will impact use by analysts).
• Evaluates all work is completed in compliance with Privacy and Security Policies and Procedures and migration project practices.
• Meets timelines and milestones by monitoring deliverables. Identifies, reports and helps solve potential risks and issues.
• Coaches and mentors internal staff in data conversion techniques.
  
  

Qualifications

SKILLS REQUIRED

Application Development: Git - 3 - 5 years

SQL- 3 - 5 years

Informatica - Data Engineering (a.k.a. BDM) 5+ years

Python - 5+ years

Core Skills and Processes - Jupyter Notebooks (IDE) - 3+ years

Apache Spark - 5+ years

Apache Parquet - 5+ years

Summary

SKILLS REQUIRED

Application Development: Git - 3 - 5 years

SQL- 3 - 5 years

Informatica - Data Engineering (a.k.a. BDM) 5+ years

Python - 5+ years

Core Skills and Processes - Jupyter Notebooks (IDE) - 3+ years

Apache Spark - 5+ years

Apache Parquet - 5+ years

Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.

Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to [email protected] to ensure their ability to fully participate in the interview process.