Coimbatore, Tamil Nadu, India, India
November 20, 2023
Apply NowJob description
This is a remote position.
We are seeking a highly skilled and motivated Senior Data Engineer with 5-7 years of experience to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience in Python, Spark, Airflow, SQL, and either BigQuery or Snowflake.
Responsibilities
Design, construct, install, test and maintain highly scalable data management systems.
Ensure systems meet business requirements and industry practices.
Build high-performance algorithms, prototypes, predictive models and proof of concepts.
Research opportunities for data acquisition and new uses for existing data.
Develop data set processes for data modeling, mining and production.
Integrate new data management technologies and software engineering tools into existing structures.
Create custom software components and analytics applications.
Install and update disaster recovery procedures.
Recommend ways to improve data reliability, efficiency and quality.
Collaborate with data architects, modelers and IT team members on project goals.
Requirements
5-7 years of experience in a Data Engineer role.
Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
Experience with big data tools: Spark, Hadoop, etc.
Experience with relational SQL and NoSQL databases.
Experience with data pipeline and workflow management tools: Airflow, etc.
Experience with cloud services: BigQuery or Snowflake.
Experience with object-oriented/object function scripting languages: Python, etc.
Nice to Have
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
We are seeking a highly skilled and motivated Senior Data Engineer with 5-7 years of experience to join our team. The ideal candidate will have a strong background in data engineering, with extensive experience in Python, Spark, Airflow, SQL, and either BigQuery or Snowflake.
Responsibilities
Design, construct, install, test and maintain highly scalable data management systems.
Ensure systems meet business requirements and industry practices.
Build high-performance algorithms, prototypes, predictive models and proof of concepts.
Research opportunities for data acquisition and new uses for existing data.
Develop data set processes for data modeling, mining and production.
Integrate new data management technologies and software engineering tools into existing structures.
Create custom software components and analytics applications.
Install and update disaster recovery procedures.
Recommend ways to improve data reliability, efficiency and quality.
Collaborate with data architects, modelers and IT team members on project goals.
Requirements
5-7 years of experience in a Data Engineer role.
Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
Experience with big data tools: Spark, Hadoop, etc.
Experience with relational SQL and NoSQL databases.
Experience with data pipeline and workflow management tools: Airflow, etc.
Experience with cloud services: BigQuery or Snowflake.
Experience with object-oriented/object function scripting languages: Python, etc.
Nice to Have
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
