Senior Data Engineer - Remote

Company:
Location: Austin, TX 78702

*** Mention DataYoshi when applying ***

This role is 100% Remote and is full-time/permanent salary + Pre Series A equity.

Our client is a Pre-Series A, well-funded company that has found market fit much more quickly than they could have ever imagined. They are in the business of providing competitive intelligence to large customers in one of the fastest-growing consumer industries to help them better decide where to focus their resources and better make billion dollar decisions.

Our client licenses raw transaction data from 3rd party partners and ingests that data into the Google Cloud Platform (GCP) where they use Google Storage, and tools like BigQuery to create a PostgreSQL database which Data Scientists uses to create data models and actionable insights and a Data Analyst ultimately create customer-facing visualizations, and charts. You will be at the top of the data funnel, managing data pipelines, ensuring data is ingested, performing quality checks, setting up alerting systems, ensuring scalability and managing PySpark jobs for processing data to ensure relevant data is ingested into the PostGresSQL database.

Who you are:

  • 5+ years of experience building complex data pipelines and data products.
  • You love data – and enjoy pushing the boundaries of what insights can be gleaned from it.
  • Proficiency in Python / Django / PostgreSQL.
  • Proficiency in Google Cloud Platform preferred though AWS experience can substitute if you are a quick learner.
  • Strong background in distributed data processing (e.g. Spark), software engineering design, and data modeling concepts.
  • Experience with business intelligence (BI) products and deploying machine learning models is a plus.
  • Strong in written and verbal communication.

What You’ll Do


  • Create reliable data pipelines and build intuitive data products that allow our Data Analysts and Data Scientists to easily leverage data in a self-service manner.
  • Design, build and deploy streaming and batch data pipelines capable of processing and storing data quickly and reliably.
  • Integrate with a variety of data sources such as email receipt data, credit card data, and more.
  • Ensure data quality and build tools to detect and alert our team of any anomalies.
  • Maintain an efficient data infrastructure.

*** Mention DataYoshi when applying ***

Offers you may like...

  • Vistaprint

    Senior Data Analyst- US Remote
    Waltham, MA 02451
  • UnitedHealth Group

    Senior Data Analyst - Telecommute
    Eden Prairie, MN 55344
  • Lionbridge Technologies

    Senior Data Analyst
    Ballina, County Mayo
  • Shopee

    Senior Data Analyst - User Behaviour & Product Ana...
    Singapore
  • Shopee

    Senior Data Analyst - Brand Analytics
    Singapore