All new
Data Science
jobs, in one place.

Updated daily to help you be the first to apply ⏱

Senior Big Data Engineer
  • Python
  • Spark
  • Big Data
  • Excel
  • ETL
  • Modeling
  • Hadoop
  • MapReduce
  • Scala
  • Kafka
Michael Page HK
Hong Kong
158 days ago
As Senior Big Data Engineer, you are responsible for
Responsible for the integration of large, structured and unstructured data volumes into the existing platforms

Design, build, deploy and manage end-to-end data pipelines for batch and stream processing that can adequately handle the needs of a rapidly growing data-driven company

Build out scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of data sources

Execution of further development of the physical implementation of the logical data model into a physical implementation in the data lake

Implementation of solutions for reference data and master data management within the context of the mobility data business

Execution of data quality measurements and implementation of data quality improvement activities to the required levels of data quality

Work across various stakeholders to ensure smooth production deployment of data pipeline and adherence to data governance policies.

Representation of the Data Architecture team in selected data architecture, data modeling, and metadata management work teams inside Mobility

Proactively identify and suggest solutions to improve data engineering process.

Technology-driven supply chain start-up

ETL, Data cleansing & product optimisation

University degree in Mathematics, Computer Science or related discipline

At least 5 years of relevant work experience as a Big Data Engineer

Farmiliar with cloud technologies eg. AWS
3+ years experience in data streaming processing pipeline, Kafka, Spark, Flume. Familiar with Airflow
Experienced with ETL / ELT scripting, buiding and ,maintaining an integrated enterprise Data Lake system

Experience working with Hadoop techncial stack, architecture and building data-intensive aplications and pipelines.

Strong Experience with programming languages in Scala, Python, Pig, MapReduce, Hive

Experience in Delta Lake, Schema Registry, Splunk, Impala is a plus
Have passion and enthusiasm to master new technology

Lateral thinking, passionate, innovative and creative.

Ability to work in a fast-paced and dynamic environment.

Excellent in working effectively in a multi-tasking environment, ability to prioritize competing tasks

Passion for building tools and automating everything

Our client is a technology-driven supply chain company with business across the globe. They are currently hiring a analytical and innovative candidate to perform big data cleansing, engineering and product optimisation.

Our client provide attractive benefit package and sustainable career development opportunities

Technology-driven supply chain start-up
Big data engineering, data cleansing and product optimisation
Multinational working environment
Matrix data science team
Opportunity to grow

    Related Jobs

  • Data Analyst (CRM, 30-60k)

    • Data Analysis
    • Database
    Hong Kong
    18 days ago
  • Senior Data Scientist

    • Machine Learning
    Monster HK
    Hong Kong
    18 days ago
  • Data Analyst

    • Database
    • Power BI
    Robert Half
    14 days ago
  • Data Analyst (Fresh Graduates are welcomed)

    • Modeling
    Hong Kong
    5 days ago
  • Solution Architect - AI & Machine Learning

    • NLP
    • Deep Learning
    Oliver James Associates
    Hong Kong Island
    19 days ago