Lead Data Engineer, Business Intelligence

At PitchBook we work to provide global professionals with comprehensive data on the entire venture capital, private equity and M&A landscape so they can discover and execute opportunities with confidence. We credit our success and rapid growth to our cutting-edge products, customer centered attitude and ability to embrace and drive change.

In just over a decade, PitchBook has reached over 1,300 global employees with offices worldwide, and we’re not slowing down! Consistently recognized as a Best Place to Work, our culture is at the heart of our success and is driven by excellence, inclusion and fun. At PitchBook we’re committed to fostering an open and collaborative work environment.

About the Role:

The Lead Data Engineer works with other Engineers and Analytics professionals as part of the team that develops data pipelines and insights for our internal stakeholders across Sales, Customer Success, Marketing, Data Operations, Product, Finance and Administration. The main tools we use are Python, Docker, Kubernetes, AWS, Git, Snowflake, and Tableau. We’d like to find someone experienced in these or similar technologies.

We’re looking for someone who can help us take our data systems to the next level. This means you’ll need a strong technical foundation in data engineering and the ability to make good choices around technology while keeping concrete business impact and long-term implications in mind. We’re excited about the tech stack we’ve built, and we’re excited for you to help us take it to the next level. If you’re a data systems expert who wants to stay close to the code while having a major impact, this is the role for you.

Primary Job Responsibilities:

• Act as a technical lead for a team comprising a Data Engineer and Data Architect
• You’ll be responsible for coordination, timely delivery, communication and providing technical mentorship for a small team
• Provide senior-level technical consulting to other engineers during design and development for highly complex and critical data projects
• Assist in the design, development, documentation and maintenance of database and reporting structures used to compile insights
• Build unified data tech to support advanced and automated business analytics
• Define, develop and review ETL processes and data modeling solutions
• Consistently evolve data processes and techniques in accordance with industry best practices
• Contribute to ongoing improvement of quality assurance standards and procedures

Skills and Qualifications:

• 3+ years in a technical leadership position
• 7+ years with Cloud-based big data storage technologies (Snowflake, Amazon Redshift)
• Bachelor’s degree in Computer Science or related field, or equivalent experience
• Understanding of advanced data warehousing concepts and track record of applying these concepts on the job
• Advanced SQL skills, including understanding of query performance
• Strong understanding of Python for data engineering, including good grasp of performance and architecture that is scalable from a resource and organizational perspective
• Ability to display complex quantitative data in a simple, intuitive format and to present findings in a clear and concise manner
• Excellent interpersonal skills, with the ability to communicate complex data issues correctly and clearly to both internal and external customers
• Experience with open-source data pipeline frameworks such as: Airflow, Luigi, etc
• Experience with Amazon Web Services and/or other cloud services
• Experience with Snowflake data warehousing or similar next-gen data warehousing technology
• Experience with a version control system such as Git
• Experience with presenting actionable insights to business stakeholders

Preferred Qualifications:

• Experience with BI software programs, such as Tableau or Microsoft Power BI
• Data Science expertise
• Relevant postgraduate degree
• Interest in or understanding of finance in general, and private capital markets in particular

If you are ready to start the conversation about how you might contribute to all the happenings at PitchBook, submit your resume today! PitchBook appreciates and respects diversity, and as such, we are an equal opportunity employer.

#LI-JH1