Data Engineer

The world’s most popular audio streaming subscription service is looking for a Data Engineer to join the band in a consultant assignment. The client has transformed music listening forever when launched in 2008.

Period: 2024-11-04 to 2025-05-04 (full-time), with a possibility of extension.

About the role

User Platform (UP) is a studio in client’s Platform mission. The Platform mission is responsible for building the tooling and support platforms for the engineering teams at the company. UP owns the platforms for authentication, authorization, user account data, and user experience configuration at the company. UP was formed with the mission to provide a secure platform that helps users establish their identities and manage their account data on different surfaces. User Platform is responsible for many of the core services needed to function and provide 380M+ users across the world access to the audio experience they desire.

During this assignment we want to enable anyone at the company, including the UP studio, to understand users’ identity and access patterns effectively, to form better experiences within user acquisition and retention, strengthen account security as well as improve the global client product decision making. Achieving this requires a significant investment in enhancing our IAM data health and structure.

We are looking for a talented, engaged data engineer to help our teams working on large and highly available data sets that form the backbone of our product experience for hundreds of millions of users across the globe.

The projects objectives:
-Define IAM Domain Data Schema
-Propose the most efficient and scalable data schemas tailored to the needs of the IAM domain. This involves understanding the current IAM systems, identifying gaps, and proposing improvements in the data structure
-Establish Data Governance and Ownership
-Set clear roles and responsibilities for data management, define data quality metrics, and ensure compliance with internal and external data policies. Create comprehensive documentation outlining best practices for data modeling specific to the IAM domain.
-Collaborate with Engineering Teams on Event Instrumentation
-Work closely with the engineering teams to set instrumentation requirements and to ensure the collected data is accurate and actionable

What you'll do

• Work in multi-functional agile teams with end-to-end responsibility for product development and delivery within your organization
• Explore new ways of producing, processing, and analyzing data in order to unlock insights into both our users and our product features
• Design, develop, and test data-driven products and features
• Work with state-of-the-art data processing frameworks, technologies, and platforms
• Improve data quality through testing, tooling and continuously evaluating performance
• Work with other software engineers, data scientists, and decision-makers, such as engineering and product managers, to build solutions and gain novel insights
• Act as the bridge between our Engineering and Insights team and work on data cataloging / management and build/maintain crucial data pipelines

Who you are

• You have 3+ years of hands-on experience in the development of data products (using Scala, Python, SQL)
• 3+ years of architecture and design (patterns, reliability, scalability, quality) of complex systems
• Advanced coding skills and practices (concurrency, distributed systems, functional principles, performance optimization)
• Experience in operating and maintaining production grade software
• Knowledge of software engineering standard methodologies
• Experience performing analysis with large datasets in a cloud based-environment, preferably with an understanding of Google’s Cloud Platform
• You have experience with JVM-based data processing frameworks such as Beam, Spark, and Flink. You understand their APIs and can debug their internals
• You have a proven understanding of data modeling, data access, and data storage, caching, replication, and optimization techniques
• You understand the value of collaboration within teams. You are comfortable with asynchronous communication, being able to work independently while always sharing context with your team members
• Experience with backend engineering is a plus.

We are Market Partner

Market Partner is proud to be an equal opportunity employer. You are welcome to our community regardless of who you are, no matter where you come from, or what you look like.