Data Engineer

• Innovative Projects: Lead the development of scalable data solutions |Flexible Work: Hybrid work model with occasional office visits in Melbourne
  
  

About Our Client

Our client is a retail giant in Australia who provide fresh produce, general merchandise, liquor and fuel to millions of customers. With over 2,200 locations nationwide and over 100,000 employees they have a reputation for excellence in their industry. The team culture is fantastic with a customer driven approach and a focus on goals and values. They are looking for someone in this role who can hit the ground running and add value to their highly motivated team.

Job Description

Job Description

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.

Key Responsibilities

• Design, construct, install, test and maintain highly scalable data management systems.
• Develop and implement data pipelines in Azure Data Factory (ADF).
• Implement complex, scalable, and robust architecture to support real-time data streaming using Spark.
• Work closely with data science and engineering teams to provide direct and indirect data-related support.
• Ensure systems meet business requirements and industry practices.
• Integrate up-and-coming data management and software engineering technologies into existing data structures.
• Develop set processes for data mining, data modelling, and data production.
• Create custom software components and analytics applications.
• Research new uses for existing data.
  
  

The Successful Applicant

• Experience: strong experience in data engineering with a strong track record in Azure and PySpark applications.
• Technical Skills: Proficient in designing and maintaining scalable data systems, developing data pipelines with Azure Data Factory, and implementing real-time streaming with Spark.
• Problem-Solving: Excellent analytical and troubleshooting skills, with the ability to optimize data processes and integrate new technologies.
• Collaboration: Proven ability to work effectively with data science and engineering teams to meet data requirements and support business needs.
• Adaptability: Experience with emerging data management technologies and a knack for developing innovative solutions.
• Communication: Strong communication skills to clearly articulate technical concepts and collaborate with cross-functional teams.
  
  

What's On Offer

• Flexible Work Arrangements: Enjoy a hybrid work model with the flexibility to work from home and occasional office visits in Melbourne.
• Competitive Rate: Up to $1,100/day incl. super for a 6-month contract.
• Career Development: Opportunity to work on high-impact projects and advance your career in a leading data-centric role.
• Inclusive Culture: A commitment to a diverse and inclusive workplace with ongoing DEI initiatives.
• On-site cafe
• Fitness club facilities
  
  

Contact: Divya Khangura

Quote job ref: JN-092024-6527774