Data Engineer

Job Description Experience- 6-7 Years Qualifications - A Bachelor s/ Master s degree in Computer Science/Engineering (or Equivalent experience) 6+ years of experience of total data engineering experience. Solid experience in end-to-end ETL/ELT, Data Lake on the cloud, data unification and harmonization, data cleansing, data enrichment, data wrangling, and reporting, within a given business context. Experience with Azure Data Factory, Databricks, Function App, Logic App, etc. within the Azure ecosystem will be highly preferred . - Ability to think independently and take ownership. Ability to lead and drive the best out of the people. Ability to understand the business needs and objectives of our clients, with good communication skills. Excellent analytical skills with a passion for solving problems using data. Technical Skillset Python and SQL (Must have) ETL/EL Data Lake Cloud Technologies Azure Data Factory, Databricks, Function App, Logic App, etc. Big Data... processing such as Spark Role Description Understand the business needs and objectives of our clients from various sectors such as FMCG, E-commerce, FinTech, Manufacturing, etc. Organize and drive successful completion of projects through effective management of analysts and effective collaboration with client stakeholders. Liaise with clients to fully understand data content and context. Make an impact through recommendations towards the best data science approach/technology/algorithm to be used for any given problem statement at hand. - Design and develop a complete solution stack for scalable, available, secure data infrastructure. - Build end-to-end automated data engineering pipelines and ETL/ELT on the cloud. Use microservice architecture to design and develop RESTful APIs catering to big data / ML / external consumption,

This job is provided by Shine.com