Senior Data Engineer (Fintech Startup)

Who is Recruiting from Scratch:

Our client is a growing startup with industries expert including serial entrepreneurs and founders. Are you looking for a growing startup you can join? A place where you can really contribute, and not just be another PR in the pipeline? Want to join a team of talented developers that enjoy working together and all have a say in how things are built?

There are over 3B people worldwide each year are being denied access to products and services they love because their perfectly legitimate payment methods are falsely declined. For subscription, membership, and e-commerce companies this “accidental churn” is expected to total over $443 billion of lost revenue per year.

Our client helps:

• Retain the up to 4% of total customers who are lost today by ensuring legitimate payments go through
  

• Delivers up to $1M and more found money (in the sofa) per year for our customers
  

• Gives access to the world’s best payment technology with “no code”
  

What are they looking for?

• You're our data handler. You make sure our data shows up on time, arrives in good condition and leaves the party when appropriate.

Problem TLDR:

Dirty data gets in the way of reporting, machine learning models and our general sanity.
Problem Expanded:

They ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines. They are seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code?

As they expand their product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.

Scope:

You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective. No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.

Y
ou'll have 3+ years experience and be familiar with distributed systems and data processing frameworks such as Scala and Spark

• Workflow orchestration tools like Argo and Airflow. You've worked in a cloud environment such as AWS, GCP or Azure. Yes, other languages/tools are fine as long as you can articulate how you've used the technology to solve similar problems.
  

• Designing a data system from scratch is something that excites you and you're able to clearly articulate the tradeoffs of different approaches.
  

• You've likely built some version of this before, validated data, created reports and perhaps dabbled in an ML model or too.

Philosophies of Client:

You strongly believe that action creates information.

You want to work on a small team and have lots of responsibility.

You look forward to being scrappy and enjoy overcoming challenges.

This role can be performed remotely anywhere in the United States with the exception of Colorado.