Mahindra Group - Data Engineer - Python/Spark

Job Description

As a Data Engineer at Mahindra and Mahindra, you will play a crucial role in designing, developing, and maintaining our data infrastructure and pipelines. You will work closely with our data scientists, analysts, and Group companies' stakeholders to ensure that data is accessible, reliable, and ready for analysis. This is an exciting opportunity to make a significant impact on our data-driven initiatives.

Key Responsibilities

• Design, build, and optimize data pipelines for diverse data sources.
• Develop and maintain data models to support analytics and reporting.
• Ensure data quality through validation processes and performance tuning.
• Collaborate with cross-functional teams and maintain data security measures.
• Implement and maintain data security and privacy measures to protect sensitive information.
  
  

Qualifications

• Bachelor's degree in computer science, Information Technology, or a related field.
• 2-5 years of experience as a Data Engineer or in a similar role.
• Proficiency in programming languages - Python, Spark etc.
• Strong SQL skills and experience with relational databases.
• Experience with data warehousing solutions (e.g., AWS Redshift, Google Big Query, Snowflake).
• Knowledge of ETL tools (Glue, Athena, DataPrep etc.) and frameworks (EMR, Dataproc etc.)
• Knowledge of Streaming frameworks (Kafka, Kinesis, Pub Sub etc.)
• Familiarity with data modeling and data integration best practices.
• Understanding of data quality and data governance principles.
• Excellent problem-solving and analytical skills.
• Effective communication and teamwork abilities.
• Experience with cloud platforms (AWS, Azure, GCP)
  
  

(ref:hirist.com)