Data Engineer Ref: GDE/ZR

Role responsibilities

• Act in technical leadership capacity and design, develop and enhance solutions
  
  
  
• Use modern development and modelling techniques and tools to implement BI and data management solutions, including data quality, metadata and reference data
  
• Engage with a wide range of technical stakeholders including data scientists, business analysts, data engineers, database administrators and solutions architects.
  
• Work with data analysts, data engineers and product owners to understand the dynamic nature that is required to support the solution that needs to be built.
  
• Load large, complex data sets to and make data available for a wide variety of stakeholders
  
• Source data from internal and external data sources, engaging with technical subject matter experts
  
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing models for greater scalability
  
• Designing and building reusable artefacts to improve speed of delivery and reliability of solutions.
  
• Identifying performance enhancements for BI and Integration solutions.
  
• Define and create solution level BI and data architecture models that are aligned with business blueprints, non-functional requirements, delivery constraints, data, application and technology standards
  
• Ensure BI and data security conforms to information security and information governance policies and standards
  
• Analyse business requirements and create related architectures and designs for the baseline (“as is”) and target (“to be”) solution architectures
  
• Document architecture and solutions for data acquisition, data integration and data management
  
• Document architecture governance processes and quality compliance criteria
  Attend and present solutions at internal architecture forums.

Qualifications and Experience

• Degree in Computer Science, Statistics, Informatics, Information Systems, Engineering or another quantitative field or National Diploma in an Information Technology related discipline preferred
  
• 5+ years Data Engineering experience with a solid background in SQL within a BI or Analytics environment
• Experience in delivering solutions within Financial services
  
  
  
• Designing, building and maintaining a modern data platform, including data lakes, data warehouses, business friendly semantic layers required
  
• Extensive data warehousing and data modelling experience using Kimbal
• Data modelling experience using Data Vault advantageous
  
  
  
• Deep technical knowledge and experience delivering data assets using SAP HANA (Attribute, calculation and Analytics Views, Functions and Stored Procedure development) required\
  
• Experience in delivering solutions using SAP HANA Predictive Analysis Library advantageous.
  
  
  
• Exposure to modern data platform technologies that support cloud, big data, real-time data provisioning, advanced analytics and artificial intelligence implementations, including event streaming based data pipelines (e.g. Cloudera Data Platform, HDFS, Hive, Spark, Oozie, Impala, Kafka and Nifi)
  
  
  
• Experience working with ETL tools required. SAP Data Services
  
  
  
• Exposure to integrating SAP HANA models with Object-oriented/object functional scripting languages (e.g. Python, Java, Scala or related)
  
  
  
• Exposure working with Data Management technologies (e.g. Informatica Data Quality (IDQ), Informatica Enterprise Data Catalog (EDC), Axon, EBX)
  
  
  
• Data architecture design and delivery experience
  
  
  
• Experience in agile development
  
  
  
• Experience in Financial Services

Knowledge and Skills

• Systems process analysis
• Business requirements
• Business process mapping
• IT governance, compliance and quality improvements
• Technologies