Senior Data engineer - AWS and Databricks

Job description

About Capgemini 
Capgemini is a diverse collective of more than 350,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, connectivity, software, digital engineering, and platforms to address the entire breadth of their business needs. This passion drives a powerful commitment - to unlock the true value of technology.   
Over the last 18 months, we have tripled our business in Australia and New Zealand, with over 3,500 team members devoted to helping clients get the future they want. Now is the time to join our rapidly growing team who are at the forefront of finding new ways technology can help us reimagine what’s possible, collecting unique career experiences with global brands and game-changing tech projects. 

Let’s talk about the team: 
Our Insights and Data team helps our clients make better business decisions by transforming an ocean of data into streams of insight. Our clients are among Australia's top performing companies, and they choose to partner with Capgemini for a very good reason - our exceptional people. Due to continued growth within Capgemini's Insights & Data practice we intend to recruit a Data Engineer with relevant consulting and communication skills. If you are already working in a consultancy role or have excellent client-facing skills gained within large organizations, we would like to discuss our consultant opportunities with you.

Let’s talk about the role and responsibilities: 
The role of Snr Data Engineer involves leading complex business reengineering development projects and to solve organizational problems through IT solutions using Big Data concepts, Platform tools and software engineering languages as required. 

Key Responsibilities include:

•    Analyzing raw data
•    Developing and maintaining datasets
•    Improving data quality and efficiency
•    Building data pipelines to move the data to conformance zones
•    Support help data conformance
•    Medallion data modelling

Key Skills/Experience:

•    Previous experience in migrating and transferring data using data pipeline
•    Previous experience in data warehouse and data lake platform
•    Knowledge of advanced SQL and writing complex SQL based procedures
•    Hands-on experience in Cloud Computing – AWS & AZURE preferably. Experience with Redshift, Databricks, HVR is highly desirable.
•    Understanding of data concepts like slowing moving dimensions, delta/snapshot migration etc.
•    Knowledge of scheduling tools like Airflow. 
•    Experience in programming, Python and shell scripting.
•    Experience with Github and Jenkins;

Additional skills/responsibilities of this role:

•    Experience working in Agile/Scrum teams;
•    Influencing & strong problem-solving skills
•    Experience wrangling data using library such as Pandas, Scikit-learn or Numpy. 
•    Experience using notebook such as Jupyter or Polyglot.
•    Experience with test-driven development, test automation & continuous delivery.
Let's talk about what's in it for you! 
We believe technology is about more than business transformation - it’s also about building a more sustainable, inclusive future. This starts with our people, working with you to get the future you want. We invite everyone to bring their whole selves to work, contributing to our inclusive culture and a safe place for our people to be themselves and truly belong. Through championing our staff-led community groups, we are committed to being active allies for everyone. We also aim to build an environment where you can thrive at work and at home. We champion remote working and are in the process of making ‘truly flexible’ working arrangements the day-to-day reality for our people. In addition, we strive to ensure your growth and learning experience is unique with access to leading learning platforms, external certifications, and opportunities to grow and learn the way you want. Finally, we offer opportunities to use your skills to help society address the impact of the digital and automation revolution, and we’re ruthlessly focused on sustainability for our clients and our business - committing to becoming a net zero business by 2030. 

Don’t meet every single requirement? Studies have shown that women and people from diverse minority backgrounds are less likely to apply to jobs unless they meet every single requirement. At Capgemini, we are dedicated to building a diverse, inclusive, and authentic workplace, so if you’re excited about this role but your experience doesn’t align perfectly, we encourage you to apply and tell us what you can bring to the role.
Capgemini Australia has developed and manages, process orientated Management Systems compliant to the requirements of ISO9001, ISO27001 and ISO14001. We are committed to delivering secure solutions and services through state-of-the-art processes and continual improvement frameworks in line with industry best practices as well as contractual, statutory, and regulatory requirements. 

#GetTheFutureYouWant - Come join us, bring your whole self to work, create new possibilities for you, your customers and your community and help us to be Architects of Positive Futures. 
We are a 2023 Circle Back Initiative Employer and commit to responding to every applicant.
Please note unsolicited resumes from employment agencies or other third parties will not be considered.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.