Data Engineer

Company:
Location: Ang Mo Kio

*** Mention DataYoshi when applying ***

  • Participate in the design, development, and testing of highly scalable, expandable and maintainable enterprise digital platform.
  • Setup and maintain big data, machine learning and Kubernetes clusters
  • Develop tools and software components which are part of the platform and can be used by different projects.
  • Work with Data Scientists, Data Analysts, and other internal stakeholders to assist with data-related technical issues and support their data pipeline infrastructure and data preparation needs.
  • Convert models from Data Scientists/Analysts into optimized & scalable production grade ML code.
  • Design, develop, and maintain optimal data pipeline for Big Data platform.
  • Develop, evaluate, recommend and maintain Big Data reporting and visualization applications
  • Troubleshoot software and system issues.

Job Requirements :

  • Bachelor or Master’s degree computer science, software engineering, information systems or related field.
  • The candidate should have at least 3 years of technical experience in Information Technology with at least 2 years in Big Data, Data Warehousing or Business Intelligent technology.
  • Broad knowledge of various aspects of Big Data with good understanding and hands-on experience in Hadoop based technologies such as HDFS, Hive, Spark, Kafka etc.
  • Deep understanding of both relational and NoSQL database technologies such as PostgreSQL, Oracle DB, Cassandra, MongoDB, Neo4J etc.
  • Good knowledge in programming languages such as Java, Python or Scala on Linux/Windows platforms.
  • Ability to write production grade ML code for edge devices will be a major plus point
  • Experience in Kubernetes and Kubeflow is a plus point
  • Experience in Big Data visualization and reporting software.
  • Experience in designing ETL/BI solutions.
  • Experience in DevOps and DataOps
  • Familiar with Linux/UNIX system administration
  • Experience in operational support in delivering Big Data solutions.
  • Effective oral and written communication with strong analytical, problem solving, multitasking and project management skills are essential on the job.

*** Mention DataYoshi when applying ***

Offers you may like...

  • UnitedHealth Group

    Senior Data Engineer Data Quality Analyst - Teleco...
    Eden Prairie, MN 55346
  • Business Mentors

    Senior Data Engineer FT
    Remote
  • umlaut North America

    Staff Data Engineer
    Remote
  • Recruiting for Good

    Remote Data Engineer with Cool Automotive Company
    Los Angeles, CA
  • XO

    Data Engineer
    Brisbane, CA 94005