Expected Experience
6+ Years
Technical Skills
6+ years of working experience in data integration and pipeline development.
6+ years with Python/PySpark/Data Bricks
2+ years of Experience with Azure Cloud on data integration with Apache Spark
Strong experience in python development especially in pySpark
Design, develop test, deploy, maintain and improve data integration pipeline.
Python, PySpark, Hive, Hadoop, Java, Tableau
Experience in Python and common python libraries.
Strong analytical experience with databases in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc.
Management Skills
Strong communication skills.
Have experience interacting with business stakeholders and customers directly.
Experience in Agile project development methodologies.
Experience with Scaled Agile Framework is a plus.