Willow Innovations

Sr. Data Engineer

Job description

About The Role:

We are building a modern data platform that will allow Willow Innovations the ability to make the most optimal business decisions. We are a growing organization and the Senior Data Engineer will make a huge influence in shaping the data strategy. If you feel a deep sense of ownership for your work, are passionate about data, desire to solve problems, are curious and love learning new things, we'd love to talk to you.

Roles & Responsibilities | What You'll Do:

  • Develop and deploy high performance data pipelines both inbound and outbound
  • Build aggregate and enriched data sets needed to effectively analyze / visualize data
  • Document, maintain and support data pipelines
  • Measure and monitor quality and availability of data
  • Implement data policies - retention, privacy, security, and compliance
  • Responsible for maintaining the Data Pipeline framework

Experience | What You'll Bring:

Must have:

  • 3 plus years of experience in building data lakes and data warehouses
  • Experience working with Cloud technologies like GCP, AWS or Azure
  • Excellent knowledge on SQL and Python programming
  • Good understanding of data formats such as JSON, Parquet, ORC, XML, etc

Nice to have:

  • Experience in tuning queries for performance and scalability
  • Experience working with any workflow management tools (Airflow, Oozie, etc)
  • Experience in Real Time Data Ingestion using Kafka, Spark, PubSub, Storm etc
  • Knowledge of NoSQL
  • Experience with Data visualization tools such as Looker, Tableau, PowerBI

Regarding our COVID-19 Vaccine Policy

Our primary concern is for the health and well-being of our employees. Employees in roles that are expected to work in the office or travel will be required to provide proof of vaccination. Medical exemptions will be considered.

Willow is proud to be an equal opportunity workplace. We are committed to equal employment opportunities regardless of gender, race, religion, sexual orientation, gender identity, age, marital status, disability, or Veteran status. See our Careers page for our commitment to diversity, equity and inclusion.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.