Data Engineer, Enterprise Data and Technology

Company:
Location: Hershey, PA

*** Mention DataYoshi when applying ***

Job Title: Data Engineer, Enterprise Data and Technology

Job Location: Hershey, PA


  • This position is open for fully remote

Summary:


The Enterprise Data organization drives value for Hershey by providing high-quality, well governed data to the Enterprise for analytics and decision-making. Working with technical product owners and business stakeholders in the commercial domain, the incumbent will ensure their data solutions meet expectations and requirements. The Data Engineering team will execute the data strategy to deliver cloud-based intelligent systems to collect, distribute, model, and analyze disparate and diverse data assets to automate insights and drive business performance.


Duties:


  • Designs and implements data pipelines to transform source data into target data models. Ensures the pipeline is validated, consistent, and performant with internal standards.
  • Drives end-to-end data and analytic solutions through accurate requirements development and focused execution.
  • Works with Commercial, Digital and Consumer teams to ensure automated data pipelines are secured according to PII standards and optimized for scaling transformations.
  • Ensures relevant data and analytics are available to meet Commercial, Digital and Consumer business/teams needs by continuously wrangling, consolidating, and modernizing existing data solutions and platforms.
  • Assists in the governance and audit controls pertaining to first party regulations.
  • Evolves the systems and capabilities that drive transformational analytics and enterprise-wide solutions and transforms data assets into business-driven solutions.
  • Engages with project teams to: understand a project’s needs/requirements, provide technical expertise with data and analytical tools (including legacy and cloud), and to deliver on project goals and timelines.
  • Strategic thinker with holistic vision. Identify existing manual processes and proposing automation solutions to drive key business performance.
  • Leads the operational activities of data transformation, data structures, metadata, dependency and workload management post go-live.

Qualifications:


Bachelor’s degree with STEM focus (e.g. Computer Science, Engineering, Mathematics or Information Systems).

3+ years of experience in data management, ingesting new data using Azure Data Factory (ADF) and transforming/integrating data using Databricks

3+ years of experience with scripting and programming languages; SQL, Python/PySpark/Scala preferred.

3+ years of professional experience related to data engineering and analytics, including:

  • Microsoft Azure (ADF, ADLS Gen 2, DevOps)
  • Apache Hadoop, Spark, or Hive
  • Relational databases (Teradata, Snowflake, or SQL Server)

3+ years of experience with public and private cloud solutions, including building and maintaining a data ecosystem; Azure preferred.

3+ Experience with building data pipelines using modern ETL tools for reporting analytics.

1-2 years of experience in mapping data sources, documenting interfaces and data movement providing lineage.

Experience with orchestrating jobs and integrating with enterprise job scheduler.

Experience with large data sets (Terabytes in size) and the techniques required to handle, store, and process.

Experience working with business owners to define and deliver key performance indicators within data and analytical solutions.

Experience working with PII data and policies.


The Hershey Company is an Equal Opportunity Employer. The policy of The Hershey Company is to extend opportunities to qualified applicants and employees on an equal basis regardless of an individual's race, color, gender, age, national origin, religion, citizenship status, marital status, sexual orientation, gender identity, transgender status, physical or mental disability, protected veteran status, genetic information, pregnancy, or any other categories protected by applicable federal, state or local laws.


The Hershey Company is an Equal Opportunity Employer - Minority/Female/Disabled/Protected Veterans

*** Mention DataYoshi when applying ***

Offers you may like...

  • Synergy Global Technologies Inc.

    Data Engineer (REMOTE)
    Remote
  • ACTS, Inc.

    Data Engineer
    Jacksonville, FL 32202
  • Humana

    Senior Cloud SIEM/Data Engineer(remote virtual hom...
    Louisville, KY
  • Facebook

    Data Engineer, Infrastructure Strategy
    Remote
  • Networx System Inc.

    Business Intelligence (BI) Data Engineer
    Remote