Senior Data engineer

Job description

About Capgemini
Capgemini is a diverse collective of more than 330,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, connectivity, software, digital engineering, and platforms to address the entire breadth of their business needs. This passion drives a powerful commitment - to unlock the true value of technology.
Over the last 18 months, we have tripled our business in Australia and New Zealand, with over 3,300 team members devoted to helping clients get the future they want. Now is the time to join our rapidly growing team who are at the forefront of finding new ways technology can help us reimagine what's possible, collecting unique career experiences with global brands and game-changing tech projects.
Let's talk about the team:
Our Insights and Data team helps our clients make better business decisions by transforming an ocean of data into streams of insight. Our clients are among Australia's top performing companies, and they choose to partner with Capgemini for a very good reason - our exceptional people. Due to continued growth within Capgemini's Insights & Data practice we intend to recruit a Data Engineer with relevant consulting and communication skills. If you are already working in a consultancy role, or have excellent client-facing skills gained within large organizations, we would like to discuss our consultant opportunities with you. This role can be positioned to work from anywhere in Australia (Sydney, Melbourne, Adelaide, Brisbane, or Perth).
Job Overview
The role of Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using Big Data concepts, Platform tools and software engineering languages as required. Reports to the Feature Lead/Project Manager on the program or the lead solution designer or architect. Will take direction from the CG or client project manager for work and technical design from the solution designer or architect.
Let's talk about the role and responsibilities:
  • Designing, developing, and implementing solutions to customers organisational problems.
  • Providing high quality service delivery on engagements.
  • Designing and developing data reconciliation & metadata driven data processing frameworks.
Responsibilities and Duties:
  • Knowledge in Cloud Computing - AWS preferably
  • Knowledge in programming and shell scripting eg. Core/Python/Scala/Java
  • Knowledge in Hadoop Stack eg. Hive, Spark (Core and Streaming), Kafka, Flink, NIFI.
  • Knowledge with Github and Jenkins.
  • Knowledge on stream transform using Spark Streaming or Flink.
  • Knowledge on change data capture in a big data ecosystem.
  • Knowledge building real time or batch ingestion and transformation pipelines.
Additional skills/responsibilities of this role:
  • Knowledge on supporting a production service in a DevOps friendly environment.
  • Knowledge on working in Agile/Scrum teams.
  • Knowledge on API and cloud-native architecture.
  • Knowledge on with ‘container' technology (e.g. Docker, Kubernetes).
  • Knowledge on wrangling data using library such as Pandas, Scikit-learn or Numpy.
  • Knowledge on using notebook such as Jupyter or Polyglot.
  • Knowledge on test-driven development, test automation & continuous delivery.
  • Knowledge on in Java build automation technologies such as Gradle, Maven, Integration with Sonarqube etc.
The following qualifications would be advantageous:
  • Education level - Degree in Computer Science, Information Systems or related field
  • AWS certification would be advantageous
  • Understanding of Financial Services Industry could be advantageous
  • Data skills: Big Data, SPARK on Amazon EMR, Python, Database knowledge.
Let's talk about what's in it for you!
We believe technology is about more than business transformation - it's also about building a more sustainable, inclusive future. This starts with our people, working with you to get the future you want. We invite everyone to bring their whole selves to work, contributing to our inclusive culture and a safe place for our people to be themselves and truly belong. Through championing our staff-led community groups, we are committed to being active allies for everyone. We also aim to build an environment where you can thrive at work and at home. We champion remote working - even though you'll want to check out our beautiful offices - and are in the process of making ‘truly flexible' working arrangements the day-to-day reality for our people. In addition, we strive to ensure your growth and learning experience is unique with access to leading learning platforms, external certifications and opportunities to grow and learn the way you want. Finally, we offer opportunities to use your skills to help society address the impact of the digital and automation revolution, and we're ruthlessly focused on sustainability for our clients and our business - committing to becoming a net zero business by 2030.
We work to recruit and retain a talented and diverse workforce. We strongly encourage applications from suitably qualified candidates regardless of their gender identity, ethnicity, sexual orientation, religion, ability, intersex status or age.
Capgemini Australia has developed and manages, process orientated Management Systems compliant to the requirements of ISO9001, ISO27001 and ISO14001. We are committed to delivering secure solutions and services through state-of-the-art processes and continual improvement frameworks in line with industry best practices as well as contractual, statutory and regulatory requirements.
#GetTheFutureYouWant - Come join us, bring your whole self to work, create new possibilities for you, your customers and your community and help us to be Architects of Positive Futures.
Please note unsolicited resumes from employment agencies or other third parties will not be considered.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.