Data Engineer

Role Work with data to solve business problems, building and maintaining the infrastructure to answer questions and improve processes. Craft new workflows based on business requirements, adding value to our product and business offerings. Work closely with the product and engineering teams to develop data models and pipelines for reporting, and machine learning. Be an advocate for best practices and continued learning. Responsibilities Work closely with our engineering teams to help build complex algorithms/workflows that provide unique insights into our data. Use agile software development processes to iteratively make improvements to our data systems. Model front end and back-end data sources to help draw a more comprehensive picture of user flows throughout our system and enable powerful data analysis. Design & Build data pipelines to schedule & orchestrate a variety of tasks that clean, transform, aggregate and enrich data from disparate sources as... per requirements. Required Skills and Qualifications Bachelors degree in computer science, information technology, engineering or equivalent Strong understanding of data structures and algorithms. Hands on experience with scripting languages like Python, strongly typed languages like Go, Java, Scala, SQL, and data visualization/exploration tools. Experience with large scale data warehousing systems like BigQuery, Redshift, Snowflake. Good understanding of orchestration framework like Airflow and Kafka streams. Familiarity with AWS, GCP Infrastructure is a plus. Communication skills, especially explaining technical concepts to non-technical business leaders Comfort working in a dynamic, research-oriented team with concurrent projects Experience building or maintaining ETL processes. Performance Troubleshooting and Tuning Infra.Market focuses on E-Commerce, B2B, Construction, and Software Engineering. Their company has offices in Bengaluru, Pune, Hyderabad, Noida, and Thane West. They have a very large team that's 5000+ employees. You can view their website at https://www.infra.market or find them on Twitter, Facebook, and LinkedIn,

This job is provided by Shine.com