Ai Palette

Intern - Data Engineer

Job description

Company
Ai Palette
aipalette.com
Designation
Intern - Data Engineer
Date Listed
30 Aug 2021
Job Type
Entry Level / Junior Executive
Intern/TS
Job Period
Immediate Start, For At Least 3 Months
Profession
IT / Information Technology
Industry
Computer and IT
Location Name
Singapore
Work from Home
Allowance / Remuneration
$400 - 1,200 monthly
Company Profile

We’re Ai Palette. We think the world would be a nicer place to be if food companies could create products that the consumers really want. So we’re making it happen. After a successful 1.5 million SGD seed round in 2019, we have scaled fast in the market having Fortune 500 companies and FMCG brands as our clients. We’re already covering the major markets in APAC and the USA. We want to be the most preferred Food AI company in the world.

Job Description

Internship Project :

Extract, Transform, Load in Foresight Engine


Project Description and Objectives:

The objective of this project is to improve the ETL process in our foresight engine. We collect millions of unstructured data from various sources including social media, recipe databases and online ecommerce platforms.

Processing multiple data streams on the cloud infrastructure is important to generate actionable insights in time at scale. As a data engineer, you will be working on stream data processing using cloud tools, writing custom scripts (python) to clean and process data for downstream tasks, use monitoring and visualisation tools to manage the data ingestion and analytics.


Roles and Responsibilities:

Responsibilities

1. Research on state of the art stream processing frameworks

2. Automate ETL pipeline with the help of DevOps team

3. Write custom analytical queries

4. Use visualization tools to manage the ETL pipeline

5. Work with insights team to generate custom analytics


Preferred
Skills:

  • Algorithms

  • Python

  • SQL + NoSQL

  • Cloud technologies

Good to have:

  • Kafka

  • Elasticsearch

  • Django


Mentor:

Kasun Perera : https://www.linkedin.com/in/kasunsp/


Former Mentee Feedbacks:

[1] https://medium.com/geekculture/my-data-science-internship-the-start-up-experience-5af69abe4b43

[2] https://www.linkedin.com/pulse/eye-opening-experience-fintech-company-bryan-lim-yuqiang/


Application Instructions
Please apply for this position by submitting your text CV using InternSG.
Kindly note that only shortlisted candidates will be notified.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.