The Staffing Group

Senior Data Engineer

Job description

Senior Data Engineer- Permanent

The Company

Work with one of Big 4 Banks in one of the most complex data environments in Australia.

What will you create?

As part of the Data Provisioning Platforms team in Enterprise Data and Architecture, you will be part of the Data Onboarding Platform team responsible for enablement of data delivery to the business through the design, development and deployment of capability aligned with the business roadmap and driving efficiencies that enhance availability, performance and stability of data provisioning services.

Work in an AWS cloud environment.

Be involved in:

  • Maintain datalake and help business units onboard data
  • Curation & ingestion of data into the data platform
  • Develop and build platforms for data
  • Help business units onboard their data
  • Build the platform that maintains the data (Terrafrom)
  • Use GitHub to create Jenkins pipelines before they get deployed
  • Setup the infrastructure and maintaining the platform for other teams
  • Patching & managing outages
  • Develop Airflow

About you

  • Minimum 3 years experience as a data engineer or a software engineer within data
  • Solid knowledge of Python is mandatory
  • Knowledge of CI/CD (preferably GitHub and Jenkins but any toolset is ok)
  • AWS, Terraform, Linux, will be highly regarded but not essenital
  • Experience with Java or C# will be highly regarded but not mandatory
  • Experience using Airflow will be highly regarded
  • Experience in DevOps/Software development working in data will be highly regarded
  • Kafka, nice to have but not essential

Does this role suit you?

If you’re interested in this role, submit your resume using ‘apply now’ (no need for a cover letter!). or for a confidential discussion call Johnson Do on 0410 454 167 or email johnsond@halcyonknights.com.au

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.