The Boston Consulting Group

Senior Data Engineer - BCG GAMMA

Job description

WHAT YOU'LL DO


As a Senior Data Engineer within BCG GAMMA’s DEEP squad, you will design and develop data platforms and pipelines to produce actionable business intelligence. The Senior Data Engineer will design systems that meet business needs by applying a broad knowledge of design techniques and approaches. S/he will collaborate directly with clients and BCG case teams to answer questions and monitor outcomes, as well as contribute to the creation of presentations/pitches in respective data engineering or product topics. Specific responsibilities include:

    Manage a data engineering project module: responsible for clarifying initial objectives, setting up methodology, and quality assurance in line with overall project goals

    Analyze source systems, define underlying data sources and transformation requirements, design suitable data models and document the design/specifications

    Build automated data pipelines and create data platforms and their components with limited support

    Build automated pipelines to validate, catalog, aggregate and transform ingested data

    Assemble large and complex data sets that meet functional business requirements.

    Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.

    Manage anomalies, gaps and inconsistencies in data models

    Set up and maintain data infrastructures that support business information systems and applications with limited supervision

    Communicate with business domain experts, data analysts and engineering teams to build foundational, well-understood data sets

    Advise stakeholder decisions by articulating the impact of certain choices on a process

    Mentor junior members of the DEEP squad and client team members, improving their skills and knowledge of systems, and enhancing the team’s ability to get things done

    Proactively identify pain points and come up with ideas to improve our data processes


YOU'RE GOOD AT


    Working with others to collectively solve problems and share ideas

    Communicating with and influencing audiences

    Organizing, prioritizing, and multi-tasking to effectively manage your work

    Applying sound business and data knowledge that is actively kept up with industry trends, sources, and methods particularly on the topic of customer portfolio value management

    Working effectively in a fast-paced team and global environment

    Passionate about quality, integrity and productivity, and taking a proactive approach to maintain security measures in his/her work

    Ability to work across multiple projects and manage tight deadlines


YOU BRING (EXPERIENCE & QUALIFICATIONS)


Must have

    Bachelor's degree in Computer Science or similar relevant field with at least 5 years of experience. Advanced degree preferred.

    SQL

    ETL experience and building data models

    SQL Databases (PostgreSQL, MariaDB)

    Experience with at least one cloud service provider (AWS/Azure/GCS)

    Experience with main public cloud data services (e.g. EC2, EMR, RDS, Redshift, CosmosDB, BigQuery, etc,)

    Containerization: Docker, Kubernetes

    Programmatic platform for scheduling and monitoring data pipelines: e.g. Airflow, Oozie

Nice to have

    DevOps experience: Docker, Kubernetes etc.

    Django

    Experience with object-oriented/object function scripting languages like Python and Scala

    Unix system administration skills


YOU'LL WORK WITH


    BCG Clients

    Case teams

    BCG GAMMA squads, tribes, and data professionals

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.