Senior Data Engineer

Do you have a good grasp on Python or SQL, or experience building and running apps in cloud environments? Come join our fast-growing team! With opportunities in both Singapore and Hong Kong, we’re hiring Data Engineers that are an essential conduit to other engineering teams across our consumer-facing company, as well as our Data Insights team.

About the Data Engineering Team

Our team acts as a central nexus to connect various data producers with consumers across the company. Our customers are:

1. Other engineering teams across the company that produce or consume data that need to be combined with other data sources.
2. Analysts on the Data Insights team.

We are accountable for delivering:

1. A centralized data platform that enables engineers and analysts across the company to ingest, anonymize, and enrich with other data sources from anywhere else in the company, and to persist, analyze, purge, and otherwise process their data.
2. Tools, training, and coordination.
3. Data applications that don’t fall into any one business unit, or where the business units don’t have sufficient capabilities themselves. For example, we team up with the Data Insights team to build and operate churn-prediction models used by both humans and other systems at scale.
4. Data Catalog for documenting the sources of data and what is available for use by other teams.

Our responsibilities include:

1. Building and operating the data platform service, including defining and tracking its SLA.
2. Guiding various engineering teams to design models and schemas of the data to be fed into the platform, making sure they can be processed in a scalable way and used by analysts efficiently.
3. Guiding data analysts on the use of the data platform.
4. Building libraries/modules and reference implementations of data ingesters on several common tech stacks.
5. Guarding user privacy. While all teams are responsible for ensuring compliance of their work with our privacy policy, our team also has a veto right against processing any data that might not be compliant.
6. Partnering with other teams on projects to build data engineering solutions such as for churn-prediction, payment fraud management, and other company-wide challenges.

Other notes about our team:

• Our tech stack currently mostly focuses on AWS Redshift, Google BigQuery, Apache Airflow, Athena, dbt and Tableau..
• We have an ever-expanding range of engineering roles on the team, covering people with backgrounds in software development, infrastructure operations, data modeling and data science.

Job Responsibilities

Your responsibilities will include:

1. Understand the requirements of your internal customers, and convert them to optimized and maintainable tech designs.
2. Use your data engineering skills to design and build the ingestion, processing, storage and consumption system for data to enable other business units to make business and operational decisions using data.
3. Maintain and operate the data platform which many business units rely on to fulfill their service level targets.

Role Requirements

• Proficiency in Python and SQL, with a good understanding in runtime complexities
• Experience in building and running applications in cloud environments (AWS, Azure, or GCP)
• Knowledge in large scale batch / stream processing frameworks such as Apache Spark / Flink / Storm is a big plus
• Experience in infrastructure-as-code tools like Terraform
• Experience in data analytics and data visualization tools is a big plus
• Good command of written and spoken English