Data Engineer

• Inner South CBD
• 12 Month Contract + possible extension
• Flexible Working

This department is approaching the final year of its digital transformation program and requires a Data Engineer to work as part of a team of cloud and data specialists developing and support new cloud data platform capabilities.

Responsibilities Include

• Provide expert problem solving, analytics thinking and advice in the design, construction and deployment of data pipelines and models in the Azure cloud that enable consistent and equitable collection and use of data to support the FAIR data principles and meet business data needs.
• Analyse and solve complex problems to provide innovative solutions and architecture to meet business data needs, providing technical leadership, guidance and coaching on ways to improve data reliability, efficiency and quality.
• Provide leadership, guidance and review of data products to ensure quality and compliance with architectural and governance requirements in relation to development and ongoing enhancements, including ETL/ELT processes and programming to enable timely and reliable access to data for action.

The Data Engineer must have experience in and knowledge of the following:

• Development experience with Azure Data Components or similar ETL tools such as SSIS - Azure Data Factory, Azure SQL, Azure Data Lake, Azure Analysis Services, Azure Synapse and Azure Databricks, Azure Machine Learning.
• Database experience in MS SQL Server, Data Warehouse, blob storage, NoSQL/Hadoop oriented databases.
• Experience working with big data sets and file formats including Parquet, Spark, AzureML.
• Experience with a range of diverse data sets including structured, non-structured, CSV, XML, JSON, Web API
• Experience with popular data discovery and analytics tools like PowerBI, Tableau
• Experience applying Continuous Integration, Continuous Delivery and Agile practices, unit & integration tests, and development practices.
• Experience working in an Agile environment using tools such as Jira and Confluence
• Builds and maintains positive relationships with team members, stakeholders and customers, and possess a high degree of interpersonal and negotiation skills, and the ability to work collaboratively with stakeholders of all levels and styles.
• Skilled in the use of desktop productivity tools such as Microsoft Teams, Word, Excel, PowerPoint and Microsoft Outlook (e-mail).

Highly Desirable Qualifications/Certifications/Skills

• Azure Data Engineer Associate Certification
• Development experience in Python, R, PowerShell
• Experience in API development for analytic/ML end points
• Data Governance experience including Master Data Management (MDM) and Data Quality tools and processes

If you have the necessary qualifications and experience, and you are a self-motivated, enthusiastic, and results-oriented person with good interpersonal skills, please apply for this exciting opportunity today.

If you would like more information or to discuss the role, please contact Julie Bow on 07 3230 0036

Job Reference: 585619