Data Engineer

JD: We are looking for a skilled Data Engineer with 8 to 10 years of experience to join our team.

Data Migration: The candidate will work on projects involving the migration of data from flat files to Redshift. This will involve the use of Glue-PySpark and Datasync.

Terraform Experience: The candidate should have experience with Terraform. This is a crucial requirement for the role.

Amazon Data Migration Service (DMS) to Kafka Migration: In the future, the candidate will also be involved in a project to migrate away from Amazon DMS to Kafka.

Requirements

• Proven experience as a Data Engineer or similar role.
• 8 to 10 years of experience in the field.
• Experience with AWS Glue, PySpark, and AWS DataSync.
• Strong knowledge of Terraform.
• Experience with Amazon DMS and Kafka.
• Proficiency in Python scripting.
• Excellent problem-solving abilities and detail orientation.
• Strong communication and teamwork skills.
  
  

Responsibilities

• Migrate data from flat files to Redshift using Glue-PySpark and Datasync.
• Utilize Terraform for various tasks and projects.
• Participate in a project to migrate from Amazon DMS to Kafka in the future.