Mandatory Skills - Python , Spark -Azure databricks -Azure Deltalake -Azure datafactory
Previous hands-on professional experience in developing and maintaining data pipelines on AWS and Databricks
Coding proficiency with Python
Good Work experience on AWS Essentials such as s3, IAM, EC2, Lambda
Engineering and Orchestrating Batch Data Pipelines using AWS Glue Workflows
Knowledge on Streaming Pipelines using AWS Kinesis
Tech stack: AWS, Databricks, Glue, Python, PySpark, DBT for developing ETL
Hands-on Skills With SQL
Strong understanding of data, systems and end to end data processes within functional area.
Ability to work with agile delivery methodologies.