All new
Data Science
jobs, in one place.

Updated daily to help you be the first to apply ⏱

Senior Data Engineer
  • Spark
  • SQL
  • Big Data
  • Tableau
  • Database
  • Modeling
  • Redis
  • Kafka
  • NoSQL
  • C#
154 days ago

Senior Data Engineer

Who We Are

At TCGplayer, we provide eCommerce and software services that connect the collectible gaming industry. We're best known for being the top online marketplace and price resource for trading card games like Magic: The Gathering, Yu-Gi-Oh! and Pokémon. We also provide services to local game stores across the country to help them grow their businesses. Our order fulfillment program helps local game stores streamline shipping for their online orders, saving them time and money.

Job Summary

The Engineering Team at TCGplayer creates and maintains a suite of products in support of our role as the leading online marketplace for trading card games and collectibles. We build applications and technologies that connect thousands of businesses with customers across the collectible gaming industry, powering sales through physical stores, websites, mobile apps and the TCGplayer Marketplace.

The Senior Data Engineer is responsible for overseeing junior data engineering activities and aiding in building the business' data collection systems and processing pipelines. The role of the Senior Data Engineer is responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.

The Senior Data Engineer builds data processing frameworks that handle the business's growing database. This individual will work with senior data science leadership as well as other Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau, and Spark. The Senior Data Engineer strives to continuously develop new and improved data engineering capabilities.

Essential Functions

  • Integrating data solutions with the current platform to ingest data into appropriate data structures (RDBMS vs Redis vs kafka vs dynamo vs others)
  • Leverage big data technologies to aggregate and analyze user behavior data (perhaps Redshift, Tableau, and all the modeling tools in between)
  • Take a data-driven approach when designing and testing search and recommendation relevance models
  • Monitor data platforms and web services for data integrity and system reliability
  • Work with other teams to create microservice applications and API interfaces (accent on proper DB design, injection and retrieval of data)
  • Designing and building robust and efficient data pipelines which support recommender systems, search engine indexing, and a variety of web services

Required Qualifications

  • 11 years of practical experience or equivalent (BS, MS)
  • Expert with SQL, and RDBMS Technologies such as (MS SQL Server, Oracle, PostGres)
  • Programing language expertise in C#
  • Mastery of at least one NoSQL repository (DynamoDB, MongoDB, redis)

Preferred Qualifications

  • Expert understanding of Elastic Search technologies
  • Expert with at least one Queueing technology such as (SQS, S3, Kafka, Rabbit MQ)
  • Expert working with AWS Technologies like EC2, Kinesis, S3, Lambda, etc

Physical Demands

The role involves the following physical demands on a regular basis:

  • Mobility to work in a standard office setting and use standard office equipment, including a computer
  • Sitting or standing for an extended period of time, up to 8 hours per day
  • Ability to use vision to read computer screen and read printed materials
  • Frequently required to stand, talk and hear

Work Environment

  • Ability to work in an open office environment

The physical demands and work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

TCGplayer is an Equal Opportunity Employer and does not discriminate against any employee for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.

    Related Jobs

  • Associate Data Scientist, Data Modeling

    • scikit-learn
    • Pandas
    • NumPy
    San Francisco
    22 days ago
  • Staff Machine Learning Engineer

    • scikit-learn
    • Java
    • Python
    9 days ago
  • Data Analyst (Enterprise Data Warehouse)

    • SQL
    • Tableau
    Partners HealthCare
    1 day ago
  • Business Data Analyst - Sr

    • Data Analysis
    Thomson Reuters
  • Senior Business Data Analyst

    • Data Analysis
    29 days ago