All new
Data Science
jobs, in one place.

Updated daily to help you be the first to apply ⏱

avatar4avatar1avatar5avatar3avatar2
Data Engineer
  • Python
  • Spark
  • Databricks
  • SQL
  • Java
  • Excel
  • Database
  • ETL
  • Hadoop
  • Scala
  • Redis
  • Kafka
  • PostGreSQL
  • Azure
Corestaff
Queensland
135 days ago

Data Engineer (x3)

  • Blue Chip Mining Company | World Class Mining Operations
  • Brisbane CBD | Newly created role | Fun start-up culture
  • 3-6 Month contract with possibility to extend

Key Responsibilities:

As successful Data Engineer:

  • You will work closely with the customers to understand their data requirements, develop, and model data structure, and design and build the ingestion process to provide access to data from operational and enterprise source systems
  • You will be involved in the design and development of data integration and data pipelines (ETL)
  • You will work with various on-prem data platforms technologies and cloud database platforms and services
  • Plan and deliver secure, good practice data integration strategies and approaches
  • You will work with customers to understand all their data requirements to develop and model data structures and data model requirements [delete and integrate into first bullet]
  • Works closely with database teams on topics related to data requirements, cleanliness, quality etc.,
  • Work with an extensive range of data centric technologies both on-prem and cloud

Requirements of the role:

To be successful, you will need:

  • Bachelor’s Degree in Computer Science/MIS/Engineering
  • Strong experience with Python, Scala, SQL, Java
  • Strong experience in traditional data warehousing / ETL tools (Informatica, Talend, Pentaho, DataStage)
  • Demonstrated experience working across structured, semi-structured, and unstructured data
  • Exposure to Cloud platforms such as: AWS, Azure, Google Platform or Databricks
  • Experience in designing and building streaming data ingestion, analysis and processing pipelines using Kafka, Kafka Streams, Spark Streaming, and similar cloud native technologies.
  • Experience with data processing systems with Hadoop, Spark, Storm, Impala, etc. duplicate of 5 ETL Tools, Denodo,
  • Experience using data virtualisation technologies (Denodo)
  • Experience deploying applications into production environments e.g. code packaging, integration testing, monitoring, release management
  • Experience in software engineering best practices such as code reviews, testing frameworks, maintainability, and readability
  • Knowledge of Data Governance and string understanding of data lineage and data quality
  • Excellent communication, listening, and influencing skills
  • Strong experience in multiple database technologies such as: Distributed Processing (Spark, Hadoop, EMR) Traditional RDBMS (MS SQL Server, Oracle, MySQL, PostgreSQL) Cloud Database Services (DynamoDB, Elasticache for Redis, Snowflake)

Desirable Skills

  • Attitude to thrive in a fun, fast-paced start-up like environment
  • Experience working on a collaborative Agile product team
  • Self-motivated with strong problem-solving and learning skills
  • Flexibility to changes in work direction as the project develops
  • Strong understanding of traditional ETL tools & RDBMS, End to End Data Pipeline duplicate
  • Experience using data virtualisation technologies (Denodo)

CoreStaff is a leader in workplace diversity and we encourage applications from Indigenous Australians for all roles, females for non-traditional female roles, and applicants with disabilities to apply for all of our jobs.

Please note that all applications will be reviewed upon submission, with only shortlisted candidates contacted further regarding the role.

Job Information

Job Reference: 200059100Salary:Salary From: £60Salary To: £80Job Industries: ITJob Locations: QueenslandJob Types: ContractJob Skills: Python, Scala, SQL, Java, ETL tools, Kafka, Kafka Streams, Spark Streaming

    Related Jobs

  • Data Engineer - Spark/Kube - 12 MONTH CONTRACT

    • Spark
    • ETL
    Opus Recruitment Solutions
    Sydney NSW
    1 day ago
  • Data Scientist

    • Machine Learning
    Woolworths Group
    Bella Vista NSW 2153
    7 days ago
  • Senior Data Scientist

    • SQL
    • Machine Learning
    • Python
    Origin Energy
    Adelaide Region SA
    3 days ago
  • Category Development Data Analyst (Secondment)

    • SQL
    • Data Analysis
    Woolworths Group
    Carlingford NSW 2118
    25 days ago
  • Data Analyst - Payments & Merchant Services Tribe

    • SQL
    • Data Analysis
    ANZ Banking Group
    Melbourne VIC
    25 days ago