We are building a modern data platform that will allow Willow Innovations the ability to make the most optimal business decisions. We are a growing organization and the Senior Data Engineer will make a huge influence in shaping the data strategy. If you feel a deep sense of ownership for your work, are passionate about data, desire to solve problems, are curious and love learning new things, we'd love to talk to you.
Roles & Responsibilities | What You'll Do:
Develop and deploy high performance data pipelines both inbound and outbound
Build aggregate and enriched data sets needed to effectively analyze / visualize data
Document, maintain and support data pipelines
Measure and monitor quality and availability of data
Implement data policies - retention, privacy, security, and compliance
Responsible for maintaining the Data Pipeline framework
Experience | What You'll Bring:
3 plus years of experience in building data lakes and data warehouses
Experience working with Cloud technologies like GCP, AWS or Azure
Excellent knowledge on SQL and Python programming
Good understanding of data formats such as JSON, Parquet, ORC, XML, etc
Nice to have:
Experience in tuning queries for performance and scalability
Experience working with any workflow management tools (Airflow, Oozie, etc)
Experience in Real Time Data Ingestion using Kafka, Spark, PubSub, Storm etc
Knowledge of NoSQL
Experience with Data visualization tools such as Looker, Tableau, PowerBI
Regarding our COVID-19 Vaccine Policy Our primary concern is for the health and well-being of our employees. Employees in roles that are expected to work in the office or travel will be required to provide proof of vaccination. Medical exemptions will be considered.
Willow is proud to be an equal opportunity workplace. We are committed to equal employment opportunities regardless of gender, race, religion, sexual orientation, gender identity, age, marital status, disability, or Veteran status. See our Careers page for our commitment to diversity, equity and inclusion.