Data Engineer 2021-68

Location: Johannesburg, Gauteng

*** Mention DataYoshi when applying ***

9 Sep '21
Data Engineer 2021-68

Information Technology, Gauteng JHB - Northern Suburbs

Market related - Market related Hourly

An International Mining Company has a CONTRACT position available for a DATA Engineer

The purpose of Global Information Management (IM) is to enable the delivery of business processes, communication, collaboration and knowledge management through the deployment, support and maintenance of enterprise IT/OT technology, infrastructure, applications and Mine Technical systems.

Phyton – Proficient
PySpark - Proficient
SQL – Competent
Solution Architecture – Competent
API Design - Competent
Containers – Competent
CI/CD – Competent
Azure Cloud - Competent
Data Stream patterns and technology – Proficient
Data stream patterns and technology – Proficient
Data engineering design patterns – Competent
Mining data – Beneficialy

An undergraduate qualification (Bachelor's degree or equivalent) in the relevant IM discipline and/or Technical competencies and certification with relevant years of experience in a similar role.

Role-specific knowledge:

  • Data Lake
  • Data Modeling
  • Data Architecture
  • Azure Data Environment

Specialist Areas:

Unstructured Data - Applies to /wiki/spaces/DAGDG/pages/1473251810 and any products that handles large scale data such as images.

Strong experience of building large scale file shipping and pipelines, ideally using Azure services such as AzCopy and Azure Data Lake. Experience of managing unstructured file meta-data, conversions, standardisation and related workflows. Experience of building analysis jobs that scale on technologies such as Databricks or Azure Batch.

Safety Knowledge:

Provides a consistent outstanding role model concerning safety practices with a deep understanding of the importance of safety

Ad Visible Until: 9 October 2021
Ref: JHB000338/DH

Vacancy Type: Contract

*** Mention DataYoshi when applying ***

Offers you may like...

  • Myticas Consulting

    BHJOB15656_16490 - Senior Data Engineer
  • MarketDial

    Data Engineer
    Salt Lake City, UT 84101
  • Applied Research Associates, Inc

    Senior Data Engineer
    Fort Belvoir, VA 22060
  • PBT Group

    Cloud Data Engineer
    Johannesburg, Gauteng
  • PBT Group

    Data Engineer
    Johannesburg, Gauteng