Data Engineer-HTHD

Job Description

The engineer will ensure the data standards, data availability, Release management, build and maintain data pipelines and fully support the goals of GDIA and the enterprise

Responsibilities

• Perform production monitoring of sources assigned to product team
• Create incidents for production failures
• Perform analysis and immediate fix (non code fixes) for the incidents
• Create problem tickets and work with Product manager to create features for production issues requiring permanent fixes
• Perform Production deployment (upon receiving KT and access) for the product team
• Perform performance tuning of data pipelines
• Maintain and monitor data pipelines; fix recurring issues and deeper data problems
• Address and fix Vulnerability issues in data pipelines
• Proactively create alerts and notifications for identifying potential issues
  
  
  

Qualifications

• 2+ years of experience in managing and deploying data pipelines
• 2+ years of experience in Python development
• Exposure to GCP Technologies
• Ability to write complex SQL queries needed to query & analyze data
• Knowledge of data management standards, data governance practices and data quality
• Good Problem solving skills
• Strong Oral and written communication skills