A Bachelors Degree in Computer Science, Information Technology or Equivalent Qualification
Technology Certifications in Databricks, Azure, Data Engineering and other technologies highly advantageous
Minimum 8 years experience as a Data Engineer
Proficiency in SQL, Python and other programming languages commonly used in data engineering.
Experience with data visualization tools such as Paginated reports (SSRS), Power BI, Tableau or QlikView
Experience in developing solutions in cloud technologies including but not limited to Azure, Databricks, SQL and Data Lake
Experience with distributed computing systems, such as Hadoop and Spark
Experience in Dimensional Modeling
Responsibilities:
Interpret requirements provided by business and develop accurate and sustainable solutions from the planning stage through to the productionised solution
Analyse, interpret and display data sets to ensure data driven solutions that address challenges and business needs within Multichoice
Ensure solutions adhere to standards and best practices and participate in solution reviews to ensure all solutions fit within standards
Operate within project environments and participate in CII continuous improvement efforts
Design and develop data models, ETL processes, and pipelines to support data ingestion, transformation, and analysis.
Work with cross-functional teams to identify data requirements, prioritize data initiatives, and drive solutions that enable data-driven decision making
Develop and maintain dashboards, reports, and visualizations that provide insights into key business metrics and trends
Design and implement data quality and data validation processes to ensure accuracy and consistency of data
Develop and maintain documentation for data models, data lineage, and data flow
Lead technical delivery within squads and provide oversight of solutions
Share knowledge and practical experience with community
Challenge and contribute to development of architectural principals and patterns
Mentor and coach junior data engineers to develop their skills and expertise