Data Engineer

Piper Companies is seeking a Data Engineer to support the development, enhancement and maintenance of data processing services used for customer reporting and billing. The Data Engineer will work in a Linux environment with multiple data stores and models (RDBMS, Redshift, Data Lake, etc), multiple data processing technologies, and multiple software languages running on Cloud infrastructure.

Responsibilities of the Data Engineer include:

• Develop Services and Products as part of an Agile (Scrum/Kanban) DevOps team responsible for end-to-end platform ownership from requirements, through the entire SDLC to production support
• Help develop/enhance/maintain large scale Data/Big Data platforms

This includes: modeling, ingesting and processing billions of records daily across multiple Database platforms

• Help develop/enhance/maintain code (Go, Perl, Python) for complex ETL data pipelines
• Develop proper instrumentation to measure the health and performance of the services you help build, easily pinpoint and address deficiencies and strive for operational excellence through continuous improvement
• Automate everything – build, test and deploy software and infrastructure

Qualifications for the Data Engineer include:

• 5+ years’ experience developing enterprise data solutions
• Experience in data-modeling and data-architecture optimized for big data patterns, data warehousing, focusing efficient storage and query performance
• Strong ETL development skills
• Experience in Python or GoLang
• Experience with infrastructure and software automation and tools (Terraform, Ansible, Jenkins, etc)
• Experience with Cloud Platforms and services such as AWS (EC2, S3, RDS, Redshift, Lambda, etc) and/or GCP, Azure or other cloud equivalents

Compensation for the Data Engineer include:

• Pay Rate: $65-80/hr W2

Salary Range: $135,000-150,000 base salary

• Benefits:
• 100% Health, Dental, Vision
• 401K w/matching
• PTO, Federal Holidays