Data Engineer

ABOUT US

At ShopRunner, we connect consumers to the brands they love by way of a thriving marketplace and a members-only service that provides benefits across 100+ of the top brands and retailers in the ecommerce space. We build products that provide a premier ecommerce experience by delivering elevated, data-driven content. The landscape of retail is changing and we're here to empower retailers to take their place in that exciting evolution.

We have people in offices around the world: Headquartered in Chicago, with offices in New York, Conshohocken, PA (Philly area), and Krakow, Poland.

ABOUT THE ROLE:

As a Data Engineer at Shoprunner, you'll help power many of our data-backed solutions and manage the large scale data we ingest from our merchant partners. Data Engineering will work in collaboration with our Enterprise, Consumer, and Data Science teams to bring data models to production, power solutions for our merchant partners, and create more personalized experiences for our customers in our never-ending quest to help our shoppers and retailers connect in new ways and new applications.

ABOUT WHAT YOU'LL DO

• Own the key data pipelines which enable real-time event handling, smarter personalization, and more nimble applications.
• Develop frameworks to productize our machine-learning models that give our members more product choices.
• Help us define and manage our big data infrastructure including Kinesis/Kafka streams, Apache Spark and Snowflake data warehouse.
• Help us evolve our service architecture, embracing architecture approaches such as 12 factor, microservices, and well-formed APIs to allow our architecture to scale both internally and externally.

ABOUT WHAT WE'RE LOOKING FOR

• Experience working in an Agile environment and using a VCS like Git.
• Experience writing production code in Python or JVM-based systems.
• Experience with data stores and technologies such as Spark, Airflow, ElasticSearch, Kinesis, Kafka, Postgres, MySQL, and Snowflake and a strong understanding of SQL.
• Experience with building REST APIs to serve and consume data
• Experience with building batch/streaming ELT pipelines to move and transform data.
• Experience with data transformation tools and techniques and workflow management
• Experience optimizing larger applications to increase speed, scalability, and extensibility.
• Proven self-starter with a strong desire to learn new technologies and work independently but knows to seek help when they are blocked.

We want you to bring your whole human self to work every day. We accept you for who you are and consider everybody on an equal opportunity basis without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.