Senior Data Engineer

Company:
Location: Port Washington, NY 11050

*** Mention DataYoshi when applying ***

Learn and work on meaningful initiatives with some of the best and brightest in the market research industry. The NPD Group provides the world’s most successful brands with leading market research, combining consumer and retail point-of-sale data with analytic solutions to interpret today’s market trends while anticipating tomorrow’s. In addition, we offer a career filled with innovation and growth to the forward-thinking problem solvers who join our team.

Position Overview

NPD is one of the leading market research providers in the world. We offer competitive market research and intelligence to our customers and many of the world’s largest companies. In addition, NPD offers a career filled with innovation and opportunity to the forward-thinking problem solvers who join our family.


The Data Engineer at NPD will occupy a key position to design and enable our next generation analytics ecosystem. You will incorporate the latest technologies for big data, analytics, and cognitive science, including machine learning. Collaborating with other IT professionals, data scientists and clients, you will leverage Azure Cloud offerings to build a system which is scalable, secure, performant, flexible, provides a superior user experience, and promotes automation to democratize big data analytics and machine learning across the enterprise.


You’re a passionate, dynamic, and highly motivated thought leader who’s looking for an opportunity to have an impact on some of the most well-known companies in the world. If you enjoy working with clients to help them make the best business decisions, this job is for you.

Overall Responsibilities:

  • Design and implement large scale data analytics system utilizing Azure Cloud and Open Source offerings to enable Business Intelligence, Analytics, Machine Learning and other Cognitive services.
  • Utilize intelligent cloud architecture to balance operational costs with performance.
  • Implement features that enable data science for a broad spectrum of users, from Code Developers to non-technical Market Researchers.
  • Engage in continuous improvement of processes and capabilities to take advantage of new technology offerings.
  • Define and automate best practices and standards, as well as implement policies developed by security, governance and other teams.
  • Write documentation in clear language that can be understood by non-technical team members.

Qualifications:

  • 7+ years’ data engineering experience working with big data, including expertise designing data models in both column store and relational databases, incorporating disparate data to solve complex business needs.
  • 3+ years’ experience with cloud technology at the enterprise level for data and analytics.
  • Expert skills developing in Spark, with Databricks experience preferred.
  • Extensive experience in SQL, including query tuning.
  • Demonstrated understanding of Business Intelligence and Report Modeling, with preference for PowerBI experience.
  • Development experience using python, R or Scala.
  • Experience with the Azure ecosystem, including ADLS, Security Services, and Synapse is preferred.
  • Extraordinary attention to detail and drive for superior product quality.
  • Proven expert in partnering and leading internal and external technology.
  • Excellent written and verbal communication skills and the ability to work within all levels of the organization.
  • BS in Computer Science, Information Systems, or similar field of study.
  • Master’s Degree in the above disciplines or MBA a plus.

The NPD Group, Inc. is an Affirmative Action/Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status or any other characteristic protected by law.

*** Mention DataYoshi when applying ***

Offers you may like...

  • Vistaprint

    Senior Digital Data Analyst, Organic Search - US R...
    Waltham, MA 02451
  • The Oregon Clinic

    Senior Data Analyst Needed for Healthcare Organiza...
    Portland, OR 97232
  • Samsara

    Senior Data Analyst
    San Francisco, CA
  • Circle

    Senior Data Analyst - Risk
    Dublin
  • Lionbridge Technologies

    Senior Data Analyst
    Ballina, County Mayo