Absa Group

Lead Data Engineer

Job description

Bring your possibility to life! Define your career with us

With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.

Job Summary

Do you love or enjoy working with data integration on Hadoop data lake? Are you an innovative, responsible, fast learning and goal oriented data engineer that is not afraid to go the extra mile to ensure successful team project delivery? Do you see project roadblocks as challenges that motives you to be better at what you do? Is your desire to automate repetitive tasks? Do you want to treat data as an asset?

If you answered yes to all of the above questions, the Data Rails team within CIB Transactional Banking Tech has the perfect opportunity for you. Be part of the young, energetic team that provides one stop data lake service to our customers. As a senior engineer you will onboard new data assets to the data lake, as well as optimize existing data pipelines to the latest data integration standards using mostly SPARK, SCALA and JAVA on Hadoop ecosystem. You will also be part of the exciting migration journey to Cloud (AWS) that the team will embark on in the near future.

Job Description

Key Accountabilities:

Development and program support
  • Development of data integration and analysis solutions using various big data technologies with a focus mainly on Spark/Scala and Java development.
  • Attend all scoping and planning workshops for BAU and project initiatives and provide input into the design process to ensure that the solution meets the business requirements.
  • Accurately estimate project activities and communicate deviations promptly to the lead or project manager for appropriate action by participating in development planning and progress review sessions.
  • Testing and peer code review.

Stakeholder and Management Reporting
  • Attend relevant project progress review sessions and provide feedback when required.

Key critical skills and experience required:
  • 7+ years of Big Data development experience using Spark, Scala, Java
  • Strong understanding of batch processing and scripting
  • Strong Hadoop architecture knowledge with the ability to troubleshoot and optimize poorly performing tasks
  • Good understanding of Java programming
  • Good understanding of metadata driven architecture
  • Understanding the end to end solutions delivery lifecycle
  • Some exposure to AWS services utilizing but not limited to EMR, Glue, Athena, S3, RDR, Step Functions, Lambda, Pipeline is beneficial

Competencies required:
  • Team collaboration
  • Mentoring and positively influencing other team members
  • Ability to effectively multi-task
  • Resilience - the ability to cope with pressure and setbacks while still meeting the deadlines
  • Planning, organizing and documentation
  • Delivering results and exceeding/meeting customer expectations
  • Excellent English and communication skills
  • Application development and support
  • Participate in future Architecture build

Education

Absa Bank Limited is an equal opportunity, affirmative action employer. In compliance with the Employment Equity Act 55 of 1998, preference will be given to suitable candidates from designated groups whose appointments will contribute towards achievement of equitable demographic representation of our workforce profile and add to the diversity of the Bank.

Absa Bank Limited reserves the right not to make an appointment to the post as advertised

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
HTC Global Services
February 7, 2024

Lead Data Engineer

Orbisk
February 7, 2024

Lead Data Engineer

Jems Group
February 7, 2024

Tech Lead Data Engineer Paris/Ile-de-France H/F