Lead Big Data Engineer

Company:
Location: Singapore

*** Mention DataYoshi when applying ***

Responsibilities

  • Responsible for the architecture design and R&D of the company's platform, ensuring project schedule and quality.
  • Responsible for the verification and implementation of new open source technologies, and promoting technology evolution of the data platform
  • Enable rapid development of company's business through data driving, and continuously improve the core competitiveness of the company

Requirements

  • Degree or above in Computer Science, Computer Engineering, Math or a related field with strong experience in java and processing big data.
  • Familiar with Java or Scala development, understand principle of JVM and familiar with common framework (Spring, Mybatis)
  • Familiar with distributed system, caching, message and other mechanism with experience in Zookeeper, Redis, Kafka
  • Familiar with Hadoop, Spark, Flink, Clickhouse, Hive, ElasticSearch, DataX, Canal and other open source software on big data processing
  • Experienced in Python development (pyspark, flask)
  • Experienced in AWS EMR big data architecture, and implementation is preferred
  • Experienced in various platform (front, middle, end) or microservice design and development, focusing on high availability and scalability of architecture

Benefits

  • Festive Gifts
  • Group Insurance
  • Flexible Working Hours
  • Up to 20 days Annual Leave
  • Employee Growth Funding
  • Regular Employee Bonding Events
  • Overtime Meal and Transport Benefits
  • Attractive Variable Bonus & Quarterly Incentives

Culture

  • We foster our core values through active listening, caring, and supporting continuous improvement for all our staff members.
  • Experience the energetic working environment with multicultural staff members with varied skills and experiences.

*** Mention DataYoshi when applying ***

Offers you may like...

  • SoftServe

    Lead Big Data Engineer (Python+GCP)
    Warszawa, mazowieckie
  • Premier Healthcare Solutions, Inc.

    Lead Big Data Engineer
    Pennsylvania
  • Fannie Mae

    Lead Big Data Engineer-AWS
    Plano, TX