We are looking for a Azure Data Engineer who wants to be a part of a team solving the ingestion, enrichment, and activation of data to drive better development, forecasting, allocation, and insights into the products we sell. In this role, you will work with the core of how we use inventory, transaction, and historical forecast data working with modern cloud and open source technology to transform the future.
You would partner with Digital Marketing, Digital Media, Business Intelligence, and product development business teams to build the next generation of data insights. This requires working alongside the platform data and product data hub groups to deliver reliable, timely, and enriched data leveraged for data-driven activities in all aspects of marketing performance.
The ideal candidate will ultimately build new data products, pipelines, APIs, materialized views, services, and tools. They are fascinated with data and the modern ways of creating rich, scalable data products driving how we work.
What you will bring:Strong data ingestion and transformation experience in a serverless-friendly scripting language. Must have experience with Azure Data Factory
Expert at digital media data – including tagging, measurement, analysis, forecasting, and reporting
Proficiency in Python and SQL
Familiarity and appreciation for modern public cloud data services from Azure
Understanding of API design, development and interaction
Proficency in version control systems (e.g. Git)
Strong accumen around data structures, relationships, integration patterns, and algorithms.
3+ years of experience being close to the business and delivering value through it as part of a team
Working knowledge of Big Data solutions such as Hadoop, NoSQL, MapReduce, etc. preferred
Understanding of pubSub platforms, e.g. Kafka, Azure Event Hubs, AWS Kinesis
Some experience applying security and privacy to how you manage data.
A grasp of the importance of common data platform patterns and how they relate like data lakes, data modeling, data lineage, data fidelity, data transformation, etc.
Job Duties & Responsibilities
Work as part of a team building the data ingestion, products, pipelines, and tooling supporting our data products driving digital media and online advertising products.
Work with stakeholders including the product, data and architecture teams to assist with data-related technical issues and support their data infrastructure needs.
Provide proactive design, operational support, and governance for privacy and security policy for data.
Level of Education
List Degree Type
- Computer Science, Software Engineering, Information Systems or Information Technology or related field required, or equivalent experience
Level of Experience
List Specific Areas of Experience
- Data Engineering, Data Modeling, Digital Media, FaceBook API, Google Marketing Cloud API
Professional License and/or Specialized Training
- Any certification on Media Analytics
Location
- Should be available in US Eastern hours
Technological Requirements
Experience with consuming, transformation and persisting large volume, high velocity data from various sources
Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores (Kafka, Pub/Sub)
Proficient with SQL
Proficiency with digital media measurement methodologies – CPM, CPA, etc. Conversion funnels, audience segmentation, clickstream analytics
Proficient with object-oriented programming and scripting languages (Python, Java, etc..)
Experience with continuous integration/continuous delivery (CI/CD) pipelines (Jenkins, Concourse, Azure DevOps)
Experience with relational databases (Oracle, SQL Server, etc..) as well as NoSQL database technologies (MongoDB, BigTable, Cassandra, etc..)
Experience with Agile Development and Agile Deployment tools and versioning using Git or similar tools
Proficient in developing, maintaining, and interacting with APIs
Proficient in Linux/Unix environments
Knowledge, Skills, & Abilities
Excellent written & Verbal Communication Skills
Execution skills
Business acumen
Strong interpersonal & client consultation skills
Ability to work effectively in a team environment
Self-motivated & results oriented
In-depth analytical skills
Strong detail orientation
Problem solving & troubleshooting capabilities
Process & procedure oriented