Data Engineer (CRC-0038)
The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure that enable efficient and accurate data processing.
The Data Engineer will work closely with data scientists, analysts, and project teams to ensure data is accessible, reliable, and optimized for performance.
Responsibilities
Design, build, and maintain scalable and efficient data pipelines and infrastructure.
Collaborate with data scientists and analysts to understand data requirements and ensure data accuracy and completeness.
Implement and maintain data modelling best practices to support business needs.
Ensure data quality and consistency across multiple sources and platforms.
Troubleshoot and optimize data pipeline performance and resolve data processing issues.
Maintain documentation related to data pipeline architecture and processes.
Stay up-to-date with the latest data engineering technologies and best practices.
Requirements
Strong understanding of data modeling and database design.
Proficient in SQL and programming languages such as Python or Java.
Experience with cloud platforms such as AWS or Azure.
Experience with code collaborations using tools such as Gitlab, or GitHub
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
