Data Engineer

Location: Cape Town, Western Cape

*** Mention DataYoshi when applying ***

  • -

Our well established, international client is seeking a Data Engineer to join our amazing Data Science Team. The Data Engineer will primarily be responsible for the discovery, design, build and migration experience for our data warehouse infrastructure. Additionally, this role will maintain the current solution and be an active participant in the decommissioning of legacy solutions.

Duties include, but not limited to

  • Plan, coordinate, develop and support Azure Data Warehouse development including architecting table structure, building ETL process, documentation, and long-term preparedness
  • Analyze, design, develop, implement, and maintain technical solutions in Azure using data warehouse technologies, including Azure Data Factory, Azure Synapse (aka Azure Data Warehouse), Azure Synapse Analytics, Azure SQL DB, Azure Logic Apps, and Azure Analysis Services
  • Assist in machine learning projects that have a dependency on Azure Databricks - Develop cross validation rules to ensure data accuracy
  • Shares in the technical cooperation of both on-shore and off-shore resources for development and quality assurance work to insure timely delivery of all reporting solutions
  • Define technical approach documents (define calculated logic, process flow)
  • Meet business requirements of the projects as new data sources are added
  • Provide production support for existing data pipelines
  • Document steps needed to migrate database objects between various environments including Development, UAT, Staging, and Production
  • Provide regular project updates to shared team resources and management as needed
  • Communicate issues, risks, and concerns proactively to management and engage colleagues while working in a hybrid Agile/Scrum process
  • Document pipelines thoroughly to allow peers to assist with support as needed
  • Provide technical assistance and task delegation to a flexible team in close coordination with Senior Stakholders
  • Engages the HUB business community as a subject matter expert champion within the Analytics Community of Practice

Essential Criteria:
  • Bachelor's degree in Computer Science or Equivalent NQF Level 7 qualification
  • 3+ years’ experience in information technology or 5 years' progressive experience with data engineering and data warehouse technologies with a focus on the Azure platform in the past five years to present
  • Microsoft Certified Professional in the Azure fundamentals track is strongly preferred
  • Knowledge of best practices in enterprise-wide database implementation, availability, and security configuration
  • Advanced experience with Azure using data warehouse technologies, including Azure Data Factory, Azure Synapse (aka Azure Data Warehouse), Azure Synapse Analytics, Azure SQL DB, Azure Logic Apps, and Azure Analysis Services, Azure Databricks
  • Knowledge of T-SQL, DAX, the Dataverse, relational database technologies and related information technology - Advanced understanding and comprehension of XML and XMLA
  • Versed in designing and overall strategy with business intelligence systems in the Microsoft Azure ecosphere
  • Knowledge and direct experience working with Azure Purview, Azure DevOps (formerly MTFS), SharePoint, PowerApps, and the M365 platform
  • Ability to function under close deadlines with minimal supervision and under potentially stressful situations
  • Excellent communication skills: capacity to explain complex solutions to non-technical business, process, and solution owner-partners internally, along with corporate executives, directors, managers, staff, and contractors

Desirable Criteria:
  • Experience in the Kimball method of database design and OLAP technology
  • Experience in relational and multi-dimensional databases as well as 2-tier and 3-tier architecture

Person Specifications:
  • Accountability and Execution
  • Resilient - Self-Starter
  • Problem Solving
  • Collaborative Relationships
  • Influences effectively
  • Time management
  • Adaptability / Flexibility
  • Attention to detail

Ad Visible Until: 31 October 2021
Ref: CPT000100/AG

Vacancy Type: Permanent

*** Mention DataYoshi when applying ***

Offers you may like...


    Data Engineer/Data Scientist/ Data Analyst
  • Govos Inc

    Big Data Engineer
  • Cognia, Inc.

    Data Engineer II
  • ProgenyHealth

    Senior Data Engineer - Remote
    Plymouth Meeting, PA 19462
  • GalaxE.Solutions

    Data Engineer
    Secaucus, NJ 07094