Career Developers, Inc.

SQL/Python Data Engineer - AWS Environment - On-si...

Job description

Refer a friend: Referral fee program

SQL/Python Data Engineer (AWS/Linux environment)
Location : Manhattan, NY - Onsite every day in NYC
Salary : 150-175K + 10% Annual Bonus (paid out Qrtly)

Our team uses a modern tech stack including Kafka, Spark, Java/ Scala/ Python, Kubernetes, Docker, AWS, Azkaban/ Airflow and modern Data Warehouses.

What You Will Do:
  • Develop and maintain ad-tech related data systems and system components using Python/Java/Scala and other software technologies
  • ETL/ELT Pipelines
  • Data-driven applications
  • Clients integration automation components (Google, Amazon, LiveRamp)
  • Work with team for technical implementation of Data Engineering projects
  • Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)
  • Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions
Requirements:
  • BS in Engineering, Computer Science or related discipline
  • Must have 3+ years strong hands-on development experience using Python
  • Experience developing, delivering and maintaining scalable data aggregation pipelines
  • Experience with relational SQL and NoSQL databases
  • Experience with AWS/ GCP/ Azure
  • Experience working in a Linux environment/ Shell Scripting
  • Experience with data pipeline and workflow management tools like Airflow, Luigi, Azkaban
  • Ability to collaborate with multiple teams and understanding testing and deployment methodologies
  • Good understanding of design patterns and effective use of data structures
  • Experience building software in continuous integration and delivery fashion in an automated way
  • Experience working in an agile software development team using Jira
  • Excellent documentation, communication, and troubleshooting skills
Is a plus:
  • Experience with big data and streaming technologies like Apache Kafka, Apache Spark and Data Warehouse (Redshift/ Snowflake/ BigQuery etc)
  • Familiarity with Docker, CI/CD and Microservices
  • Java/ Scala development experience
  • Digital advertising industry experience
Benefits:
Comprehensive healthcare, wellness programs, paid time off, commuter benefits, and 401k matching from any company, so it's a good thing we offer all of that and so much more. They offer a dog friendly office, Summer Fridays, catered lunches, a fully stocked kitchen, ZogSports teams, happy hours and corporate retreats to encourage a strong work/life balance.

ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse ETL ELT SQL data AWS Java python data warehouse

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.