- Sustainable commercial group |Data Migration Project (on premise to Databricks)
About Our Client
Our client is a sustainable commercial group with businesses across the global.
To cope with their business growth, they are currently hiring a Data Engineer to perform regional data migration projects to the cloud platform - to Databricks. This candidate will work under the data team to design and develop data pipelines, data lakes, and data warehouses, conduct ETL processes, and implement the data platform and solutions for the business.
Job Description
- Maintain and develop data warehouse and pipelines for data management
- Perform the data migration project (from on-premise to Azure Databrick)
- Optimize and build the data lake on the Azure cloud platform (Databrikck)
- Develop and maintain the data pipeline, including data sourcing, extraction, cleansing, transformation, and validation
- Design, implement, and optimize ETL data pipelines and automation
- Design, develop and deploy the data platform and solutions for business
- Collaborate with data analysts and stakeholders on business support and requirements
The Successful Applicant
- Bachelor's degree in Information Technology, Data Engineering, or other related disciplines
- At least 3 years of relevant experience in Data Engineering
- Hands-on with Azure (Databricks)
- Hands-on with SQL
- Knowledge of Azure Data Factory, Azure Data Lake, Azure Event Hub
- Hands-on experience in programming languages for data engineering (e.g., PySpark, Python, R, Java, Scala).
- Team player with good communication and problem-solving
- Strong communication skills in both Chinese and English
What's on Offer
Our client provides attractive compensation and a sustainable career path.
Contact: Julee Thapa
Quote job ref: JN-052024-6435288