Data Engineer ADF_Pittsburgh

Job description

We are looking for a Azure Data Engineer who wants to be a part of a team solving the ingestion, enrichment, and activation of data to drive better development, forecasting, allocation, and insights into the products we sell. In this role, you will work with the core of how we use inventory, transaction, and historical forecast data working with modern cloud and open source technology to transform the future.

You would partner with Digital Marketing, Digital Media, Business Intelligence, and product development business teams to build the next generation of data insights. This requires working alongside the platform data and product data hub groups to deliver reliable, timely, and enriched data leveraged for data-driven activities in all aspects of marketing performance.

The ideal candidate will ultimately build new data products, pipelines, APIs, materialized views, services, and tools. They are fascinated with data and the modern ways of creating rich, scalable data products driving how we work.

What you will bring:
Strong data ingestion and transformation experience in a serverless-friendly scripting language. Must have experience with Azure Data Factory

Expert at digital media data – including tagging, measurement, analysis, forecasting, and reporting

Proficiency in Python and SQL

Familiarity and appreciation for modern public cloud data services from Azure

Understanding of API design, development and interaction

Proficency in version control systems (e.g. Git)

Strong accumen around data structures, relationships, integration patterns, and algorithms.

3+ years of experience being close to the business and delivering value through it as part of a team

Working knowledge of Big Data solutions such as Hadoop, NoSQL, MapReduce, etc. preferred

Understanding of pubSub platforms, e.g. Kafka, Azure Event Hubs, AWS Kinesis

Some experience applying security and privacy to how you manage data.

A grasp of the importance of common data platform patterns and how they relate like data lakes, data modeling, data lineage, data fidelity, data transformation, etc.

Job Duties & Responsibilities

Work as part of a team building the data ingestion, products, pipelines, and tooling supporting our data products driving digital media and online advertising products.

Work with stakeholders including the product, data and architecture teams to assist with data-related technical issues and support their data infrastructure needs.

Provide proactive design, operational support, and governance for privacy and security policy for data.

Level of Education

  • Bachelor's Degree
List Degree Type

  • Computer Science, Software Engineering, Information Systems or Information Technology or related field required, or equivalent experience
Level of Experience

  • 3 - 5 Years
List Specific Areas of Experience

  • Data Engineering, Data Modeling, Digital Media, FaceBook API, Google Marketing Cloud API
Professional License and/or Specialized Training

  • Any certification on Media Analytics

  • Should be available in US Eastern hours
Technological Requirements

Experience with consuming, transformation and persisting large volume, high velocity data from various sources

Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores (Kafka, Pub/Sub)

Proficient with SQL

Proficiency with digital media measurement methodologies – CPM, CPA, etc. Conversion funnels, audience segmentation, clickstream analytics

Proficient with object-oriented programming and scripting languages (Python, Java, etc..)

Experience with continuous integration/continuous delivery (CI/CD) pipelines (Jenkins, Concourse, Azure DevOps)

Experience with relational databases (Oracle, SQL Server, etc..) as well as NoSQL database technologies (MongoDB, BigTable, Cassandra, etc..)

Experience with Agile Development and Agile Deployment tools and versioning using Git or similar tools

Proficient in developing, maintaining, and interacting with APIs

Proficient in Linux/Unix environments

Knowledge, Skills, & Abilities

​​Excellent written & Verbal Communication Skills

Execution skills

Business acumen

Strong interpersonal & client consultation skills

Ability to work effectively in a team environment

Self-motivated & results oriented

In-depth analytical skills

Strong detail orientation

Problem solving & troubleshooting capabilities

Process & procedure oriented

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.