Senior Data Engineer

Company:
Location: Johannesburg, Gauteng

*** Mention DataYoshi when applying ***

Role and Responsibilities

  • Responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting.
  • Build data processing frameworks that handles the businesss growing database.
  • Work with senior data science leadership as well as other Data and Analytics teams in leveraging data with reporting and scientific tools.
  • Strive to continuously develop new and improved data engineering capabilities.
  • Provide senior-level contribution to a team that is responsible for the design, deployment, and maintenance of the businesss data platforms.
  • Implement strategies directed at acquiring data and promoting the development of new insights across the business.
  • Monitor the existing metrics, analyse data, and lead partnership with other Data and Analytics teams in an effort to identify and implement system and process improvements
  • Play an analytical role where scalable data processing platforms used for exploratory data analysis and real-time analytics are developed and managed.
  • Oversee, design, and develop algorithms for real-time data processing within the business and create the frameworks that enable quick and efficient data acquisition.


Requirements

  • 3-5+ years of relevant industry experience in large back-end systems, data processing and SQL databases
  • Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL
  • Experience building code-driven infrastructure on public cloud platforms, preferably AWS
  • Understanding of SQL, dimensional modeling, and analytical data warehouses
  • Experience with automation frameworks/tools like Git, Jenkins
  • Familiarity with containers and infrastructure-as-code principles
  • Problem solver with excellent written and interpersonal skills; ability to make sound, complex decisions in a fast-paced, technical environment
  • Bachelors degree in Computer Science, Engineering or related field, or equivalent training or work experience

*** Mention DataYoshi when applying ***

Offers you may like...

  • Discover Financial Services

    Senior Data Engineer
    Remote
  • STX Next Sp z.o.o

    Senior Data Engineer
    Poznań, wielkopolskie
  • Smart-HR

    Senior Data Engineer
    zdalnie
  • Luxoft

    Senior Data Engineer
    Warszawa, mazowieckie
  • Morgan McKinley

    Senior Data Engineer (Technical)
    Cork