JD: We are looking for a skilled Data Engineer with 8 to 10 years of experience to join our team.
Data Migration: The candidate will work on projects involving the migration of data from flat files to Redshift. This will involve the use of Glue-PySpark and Datasync.
Terraform Experience: The candidate should have experience with Terraform. This is a crucial requirement for the role.
Amazon Data Migration Service (DMS) to Kafka Migration: In the future, the candidate will also be involved in a project to migrate away from Amazon DMS to Kafka.
Requirements
- Proven experience as a Data Engineer or similar role.
- 8 to 10 years of experience in the field.
- Experience with AWS Glue, PySpark, and AWS DataSync.
- Strong knowledge of Terraform.
- Experience with Amazon DMS and Kafka.
- Proficiency in Python scripting.
- Excellent problem-solving abilities and detail orientation.
- Strong communication and teamwork skills.
Responsibilities
- Migrate data from flat files to Redshift using Glue-PySpark and Datasync.
- Utilize Terraform for various tasks and projects.
- Participate in a project to migrate from Amazon DMS to Kafka in the future.