Data engineer - SQL and AWS

Job description

As a leading strategic partner to companies around the world, we have leveraged technology to enable business transformation for more than 50 years. We address the entire breadth of business needs, from strategy and design to managing operations. To do this, we draw on deep industry expertise and a command of the fast-evolving fields of cloud, data artificial intelligence, connectivity, software, digital engineering, and platforms.At Capgemini we are driven by a shared purpose: unleashing human energy through technology for an inclusive and sustainable future. Capgemini. Get the future you want.

About the service line:

Our Insights and Data team helps our clients make better business decisions by transforming an ocean of data into streams of insight. Our clients are among Australia's top performing companies, and they choose to partner with Capgemini for a very good reason - our exceptional people. Due to continued growth within Capgemini's Insights & Data practice we intend to recruit a Data Engineer with relevant consulting and communication skills. If you are already working in a consultancy role, or have excellent client-facing skills gained within large organizations, we would like to discuss our consultant opportunities with you.

Role Purpose:

Role Description:

Reports to the Feature Lead/Project Manager on the program or the lead solution designer or architect. Will take direction from the CG or client project manager for work and technical design from the solution designer or architect.

Let's Talk About The Role And Responsibilities

The role of Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using Big Data concepts, Platform tools and software engineering languages as required.

  • Analyzing raw data
  • Developing and maintaining datasets
  • Improving data quality and efficiency
  • Building data pipes to move the data to conformance zones
  • Support help data conformance
  • Previous experience in migrating and transferring data using data pipes
  • Knowledge of SQL and writing complex SQL based procedures
  • Hands-on experience in Cloud Computing - AWS preferably. Experience with Redshift or similar tool is highly desirable.
  • Understanding of data concepts like slowing moving dimensions, delta/snapshot migration etc.
  • Knowledge of scheduling tools like Airflow.
  • Experience in programming and shell scripting.
  • Experience with Github and Jenkins;

Additional skills/responsibilities of this role:

  • Experience working in Agile/Scrum teams;
  • Experience wrangling data using library such as Pandas, Scikit-learn or Numpy;
  • Experience using notebook such as Jupyter or Polyglot;
  • Experience with test-driven development, test automation & continuous delivery;

The following qualifications would be advantageous:

  • Education level - Degree in Computer Science, Information Systems or related field
  • AWS certification would be advantageous
  • Understanding of Financial Services Industry could be advantageous

About Capgemini

At Capgemini, we are more than just a business, we are a diverse global collective of strategic and technological experts who are passionate about finding ways technology can help our clients, our people and our communities get the future they want.

Our people are the key to making this vision a reality, which is why we have been recognised by the Australian Workplace Equality Index as LGTBQ+ ‘Employer of the Year' and ‘Inclusion of Trans and Gender Diverse Employees' for the past two years. We believe in creating a safe, flexible, and inclusive culture where everyone can bring their authentic selves to work, contributing to our inclusive culture and truly belong, and our staff-led community groups are a testament to this commitment. We are committed to being active allies for everyone.

We believe by combining the power of the latest technology with our human energy, we can drive sustainable thinking into our operations and the work we do with clients. Its why we are committing to becoming a carbon neutral business by 2025 and net zero by 2030.

Empower yourself with the knowledge and skills you need to succeed with our access to premier learning platforms, sought-after certifications and boundless development opportunities. You'll be encouraged to gain at least 40 hours of training each year.

For over 50 years our values and ethics have been at heart of our identity. From our approach to ethics to the way we interact with one another, honesty, boldness, trust, freedom, team spirit, modesty, and fun guide and inspire all we do and have led to us being recognised as one of the World's Most Ethical Companies by the Ethisphere Institute 10 years in a row.

Our Commitment to Diversity & Inclusion

Don't meet every single requirement for this role? Studies have shown women and people from diverse minority backgrounds are less likely to apply to jobs unless they meet every single requirement. At Capgemini, we are dedicated to building a diverse, inclusive, and authentic workplace, so if you're excited about this role but your experience doesn't align perfectly, we encourage you to apply and tell us what you can bring to the role.

We understand for some people, a standard hiring processes can come with challenges. If you are living with a disability, are gender diverse or neurodivergent and we can provide support with access requirements or by making an adjustment to our hiring process, please contact us at

Information Security and Compliance

Capgemini Australia has developed and manages, process orientated Management Systems compliant to the requirements of ISO9001, ISO27001 and ISO14001. We are committed to delivering secure solutions and services through state-of-the-art processes and continual improvement frameworks in line with industry best practices as well as contractual, statutory, and regulatory requirements.

#GetTheFutureYouWant - Come join us, bring your whole self to work, create new possibilities for you, your customers and your community and help us to be Architects of Positive Futures.

We are a 2023 Circle Back Initiative Employer and commit to responding to every applicant.

Please note unsolicited resumes from employment agencies or other third parties will not be considered.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.