Middle Data Engineer

Job Description

AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed! :)

What you will do

• Designing and implementing efficient data pipelines (ETLs) to integrate data from various sources into Indeed’s data platforms;
• Designing and implementing data model changes that align with data standards;
• Work with existing APIs written in Flask (python);
• Monitoring production data pipelines daily to ensure completion, maintain data quality, and address performance issues;
• Reading and interpreting system logs to evaluate system health or perform root cause analysis;
• Identifying pipeline issues and working with colleagues, vendors, and external teams to resolve;
• Clearly communicating pipeline statuses with management and stakeholders.
  
  

Must haves

• Ideally a bachelor’s degree in computer science, computer engineering, or an engineering discipline;
• 5+ years of industry experience in software development and/or data engineering with strong expertise in fast-paced and deliver-focused environments;
• Extensive production experience in SQL;
• Extensive experience building an ETL from scratch;
• 3+ years of experience with:
• Python/Flask;
• 3+ years of hands-on experience with big data technologies (such as Redshift, Hive, Trino/Presto, or similar technologies);
• Experience with modeling data;
• Experience in Athena;
• Experience with MySQL;
• Experience in Gitlab CI;
• Experience in AWS cloud platform (SQS, S3 services);
• Extensive experience in writing technical documentation;
• Upper-intermediate English level.
  
  

Nice to haves

• Experience in Spark;
• Experience in Tableau or Google Data Studio;
• ETL work will be in Dagster but may not be a primary focus of the individual.
  
  

The benefits of joining us

• Professional growth
  
  

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

• Competitive compensation
  
  

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

• A selection of exciting projects
  
  

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

• Flextime
  
  

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.