Lead Data Engineer

Company:
Location: Remote

*** Mention DataYoshi when applying ***

  • This position can be fully remote in the US.


ABOUT US

Wiser is the leading provider of actionable data for better decisions. Wiser collects and analyzes online and in-store data with unmatched speed, scale and accuracy. The Wiser platform then blends these insights with advanced workflow software to drive business value for brands and retailers. Using a unique combination of data science and human validation, Wiser offers integrated solutions for every aspect of retail, all in one place.


JOB DESCRIPTION

When looking to buy a product, whether it is in a brick and mortar store or online, it can be hard enough to find one that not only has the characteristics you are looking for but is also at a price that you are willing to pay. It can also be especially frustrating when you finally find one, but it is out of stock. Likewise, brands and retailers can have a difficult time getting the visibility they need to ensure you have the most seamless experience as possible in selecting their product. We at Wiser believe that shoppers should have this seamless experience, and we want to do that by providing the brands and retailers the visibility they need to make that belief a reality.

Our goal is to solve a messy problem elegantly and cost effectively. Our job is to collect, categorize, and analyze lots of structured and semi-structured data from lots of different places every day (whether it’s 20 million+ products from 500+ websites or data collected from over 300,000 brick and mortar stores across the country). We help our customers be more competitive by discovering interesting patterns in this data they can use to their advantage, while being uniquely positioned to be able to do this across both online and instore.

We are looking for a lead-level software engineer to lead the charge on a team of like-minded individuals responsible for developing the data architecture that powers our data collection process and analytics platform. If you have a passion for optimization, scaling, and integration challenges, this may be the role for you.

WHAT YOU WILL DO

  • Think like our customers – you will work with product and engineering leaders to define data solutions that support customers’ business practices.
  • Design/develop/extend our data pipeline services and architecture to implement your solutions – you will be collaborating on some of the most important and complex parts of our system that form the foundation for the business value our organization provides
  • Foster team growth – provide mentorship to both junior team members and evangelizing expertise to those on others.
  • Improve the quality of our solutions – help to build enduring trust within our organization and amongst our customers by ensuring high quality standards of the data we manage
  • Own your work – you will take responsibility to shepherd your projects from idea through delivery into production
  • Bring new ideas to the table – some of our best innovations originate within the team

TECHNOLOGIES WE USE

  • Languages: SQL, Python
  • Infrastructure: AWS, Docker, Kubernetes, Apache Airflow, Apache Spark
  • Databases: Snowflake, Redshift, MongoDB, Postgres, MySQL, EventStore
  • Others: Sisense (as a business intelligence solution)

MUST-HAVES

  • Bachelors/Master’s degree in Computer Science or relevant technical degree
  • 10+ years of professional software engineering experience
  • Strong proficiency with data languages such as Python and SQL
  • Strong proficiency working with data processing technologies such as Spark, Flink, and Airflow
  • Strong proficiency working of RDMS/NoSQL/Big Data solutions (Postgres, MongoDB, Snowflake, etc.)
  • Solid understanding of streaming solutions such as Kafka, Pulsar, Kinesis/Firehose, etc.
  • Solid understanding of Docker and Kubernetes
  • Solid understanding of ETL/ELT and OLTP/OLAP concepts
  • Solid understanding of columnar/row-oriented data structures (e.g. Parquet, ORC, Avro, etc.)
  • Proven ability to transform raw unstructured/semi-structured data into structured data in accordance to business requirements
  • Solid understanding of AWS, Linux and infrastructure concepts
  • Proven ability to diagnose and address data abnormalities in systems
  • Proven ability to learn quickly, make pragmatic decisions, and adapt to changing business needs
  • Experience building data warehouses using conformed dimensional models
  • Experience building data lakes and/or leveraging data lake solutions (e.g. Dremio, Druid, etc.)
  • Experience working with business intelligence solutions such as Sisense, Tableau, etc.
  • Understands Domain Driven Design concepts and accompanying Microservice Architecture
  • Passion for data, analytics, or machine learning.
  • Focus on value: shipping software that matters to the company and the customer

BONUS POINTS

  • Experience working within a retail or ecommerce environment.
  • Proficiency in other programming languages such as Scala, Java, Golang, etc.
  • Experience working with Apache Arrow and/or other in-memory columnar data technologies

SUPERVISORY RESPONSIBILITY

  • Provide mentorship to team members on adopted patterns and best practices.
  • Organize and lead agile ceremonies such as daily stand-ups, planning, etc.

Other Duties - Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

Travel - Occasionally as needed.

Work Environment - This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, and printers/photocopiers.

Physical Demands - The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. The employee is required to sit for prolonged periods of time; balance; and stoop, kneel, crouch or crawl. The employee must occasionally lift and/or move up to 25 pounds. Specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception and ability to adjust focus.

The employee is required to operate essential office equipment, such as computer/laptop, phone, printer/copier, keyboard, mouse, and other office equipment on a regular basis.

EEO Statement - Wiser Solutions, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. EEO is the Law. Click here to view your rights. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.


Powered by JazzHR

PmdWKCEklG

*** Mention DataYoshi when applying ***

Offers you may like...

  • EcoVadis

    Lead Data Engineer
    Warszawa, mazowieckie
  • Eolas Recruitment

    Lead Data Engineer
    Dublin
  • Maersk Global Service Centres India Private Limited

    Lead Data Engineer
    Bengaluru, Karnataka
  • Guru

    Lead Data Engineer
    Gaithersburg, MD 20878
  • GetInData

    Lead Data Scientist
    00-785 Warszawa