Data Engineer

We are actively seeking a highly experienced Data Engineer with 12 to 15 years of expertise. The ideal candidate will be well-versed in Big Data technologies such as Scala, Databricks, Spark SQL, Spark Streaming, Python, and Pyspark. Additionally, proficiency in Cloud platforms, specifically Azure and Azure Data Factory (ADF), is crucial for this role. The candidate should have a strong background in System Design, including API Design, GraphQL, Event-Driven Architecture, and Design Patterns. Experience in Microservices development using Core Java 8 or above, SpringBoot, and Azure Functions is essential.

Technical Proficiency:

• Big Data:
• Scala, Databricks, Spark SQL, Spark Streaming, Python, Pyspark
• Cloud:
• Azure, Azure Data Factory (ADF)
• System Design:
• API Design, GraphQL, Event-driven architecture, Design Patterns
• Microservices:
• Core Java 8 or above, SpringBoot, Azure Functions
• Frontend (Nice to Have):
• JavaScript, React

Key Responsibilities:

• Design and develop scalable and efficient data processing systems using Big Data technologies.
• Implement and maintain data pipelines on Cloud platforms, particularly Azure.
• Collaborate with cross-functional teams to design APIs and implement event-driven architectures.
• Develop and maintain Microservices using Core Java, SpringBoot, and Azure Functions.
• (Nice to Have) Contribute to frontend development using JavaScript and React.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience of 12 to 15 years in Data Engineering.
• Strong analytical and problem-solving skills.
• Effective communication and collaboration abilities.