May 26, 2023
Apply Now
Delhi, India, India
May 26, 2023
Apply NowJob description
Senior Data Engineer with experience in both AWS and Azure Databricks includes the following responsibilities:
- Collect, analyze, and report on structured and unstructured data from multiple sources
- Design and build data pipelines, reporting tools, information dashboards, and other end-user information portals
- Ensure stakeholders can access and manipulate data for routine and ad hoc analysis
- Work and communicate proactively with team members, technical leads, and project managers
- Use modern data engineering techniques and methods with Advanced Analytics to support business decisions for clients
- Strong experience as an AWS and Azure Data Engineer with AWS and Azure Databricks experience
- Expert proficiency in Python, PySpark, and other programming and scripting languages
- Hands-on experience with AWS and Azure data lake and analytics solutions, Kinesis, DynamoDB, Event/IoT Hubs, and Cosmos
- In-depth understanding of AWS and Azure cloud services and technologies
- Experience preparing data for data science, machine learning, and AI use cases
- Strong understanding of data modeling and defining conceptual, logical, and physical data models
- Working knowledge of RESTful APIs, OAuth2 authorization framework, and API security best practices
- Strong written and verbal communication skills
- Ability to manage competing priorities in a fast-paced environment
- Self-motivated and able to work independently
- 2+ years of hands-on experience designing and implementing multi-tenant solutions using both AWS and Azure Databricks
- 5+ years of experience in software development, data engineering, or data analytics
- Bachelor's or master's degree in a relevant field or equivalent work experience
- Ability to resolve issues
- Microsoft Certified: Azure Data Engineer Associate (nice to have)