Company Overview
Bain & Company is the management consulting firm
that the world’s business leaders come to when they want results. Bain advises
clients on strategy, operations, information technology, organization, private
equity, digital transformation and strategy, and mergers and acquisition,
developing practical insights that clients act on and transferring skills that
make change stick. The firm aligns its incentives with clients by linking
its fees to their results. Bain clients have outperformed the stock market
4 to 1. Founded in 1973, Bain has 58 offices in 37 countries, and its deep
expertise and client roster cross every industry and economic sector.
<span style=font-family: Book Antiqua, serif; font-size: 11pt;>
Position Summary
As a Data Engineer Specialist, you will be a subject
matter expert responsible for developing and maintaining data pipelines to
assist us aggregate number of client data sources into a single view for our
teams to utilize. The data is often incomplete, inconsistent and stored in
silos with access primarily through APIs and FTPs. We are looking for a
creative, experienced and motivated individual to build solutions for
integrating CRM and Marketing data in GCP & BigQuery environments.
Essential Functions
- Build and maintain custom ingestion and integration
pipelines from multiple sources(Digital Marketing and CRM data) - Establish monitoring systems to give visibility to
pipelines’ status and monitor automated jobs - Bringing consistency to our Data handling and
schemas across the board - Developing quality standards to ensure data quality
and integrity across all database systems - Partner with
analysts and data scientists to improve the efficiency and performance of
their data products - Where appropriate, train other team members to
support the development of products, tools and technologies
Qualifications
- Bachelor’s Degree in
Computer Science, Information Systems, or related field as outlined in the
essential duties - 4-7 years’ experience developing data processing and storage
solutions on a cloud architecture; prior knowledge of GCP ecosystem is a major
advantage - Experience dealing with Digital marketing and CRM data
- Experience in building pipelines from various data sources
especially APIs - Experience with Python development is preferred
- Experience with using version control via Git and CI/CD systems is preferred
- Demonstrated success as a developer in the full
scope of the development lifecycle; including, but not limited to,
understanding business needs, design, development, and deployment is preferred - Digital marketing and CRM data pipeline knowledge
- Understands efficient data warehousing designs and schemas
- Comfortable with ETL tools such as Alteryx, Parabola or Talend
- Highly skilled at writing advanced SQL queries and comfortable
with merging complex datasets into functional presentation layers for model
inputs - Comfortable with working with orchestration tools such as
Airflow, Dataproc, dbt or Cloud Composer for ETL and ELT - Knowledgeable about data infrastructure management and
Unix/Linux operating systems is preferred - Skilled at deploying containerisation solutions such as Docker
or Kubernetes is preferred