Middle Data Engineer

Job description

Job Description

AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed! :)

What you will do

  • Designing and implementing efficient data pipelines (ETLs) to integrate data from various sources into Indeed’s data platforms;
  • Designing and implementing data model changes that align with data standards;
  • Work with existing APIs written in Flask (python);
  • Monitoring production data pipelines daily to ensure completion, maintain data quality, and address performance issues;
  • Reading and interpreting system logs to evaluate system health or perform root cause analysis;
  • Identifying pipeline issues and working with colleagues, vendors, and external teams to resolve;
  • Clearly communicating pipeline statuses with management and stakeholders.

Must haves

  • Ideally a bachelor’s degree in computer science, computer engineering, or an engineering discipline;
  • 5+ years of industry experience in software development and/or data engineering with strong expertise in fast-paced and deliver-focused environments;
  • Extensive production experience in SQL;
  • Extensive experience building an ETL from scratch;
  • 3+ years of experience with:
  • Python/Flask;
  • 3+ years of hands-on experience with big data technologies (such as Redshift, Hive, Trino/Presto, or similar technologies);
  • Experience with modeling data;
  • Experience in Athena;
  • Experience with MySQL;
  • Experience in Gitlab CI;
  • Experience in AWS cloud platform (SQS, S3 services);
  • Extensive experience in writing technical documentation;
  • Upper-intermediate English level.

Nice to haves

  • Experience in Spark;
  • Experience in Tableau or Google Data Studio;
  • ETL work will be in Dagster but may not be a primary focus of the individual.

The benefits of joining us

  • Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

  • Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

  • A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

  • Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
May 24, 2024

Middle Data Analyst

May 24, 2024

Middle Data Engineer

May 24, 2024

Middle Data Engineer