Big Data Engineer

Job description

About Us:

Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

Visit to see how Infosys (NYSE: INFY) can help your enterprise navigate your next.

Short Description

The Data Engineer Big Data is responsible for designing, developing and supporting batch data pipelines and applications. You will be responsible for developing an expert-level understanding of the core capabilities and building production grade data pipelines, application and components to extend the platform.


Expert big data engineering skills including Java, Scala, Python, the Apache Big Data stack and Hortonworks HDF including Hadoop, Hive, Spark, HBase
Location Sydney, Australia

Years of EXP 7 plus years

Roles and Responsibilities

Design and build data pipelines for both analytical and operational data applications
Build capabilities on the platform that enable data analysts to rapidly consume data pipelines through data applications and exploration capabilities
Define and update data models and associated technical and business metadata
Work closely with Product Owners, Architects and delivery teams to build systems that drive towards its strategic platform vision
Optimise and contribute to existing Platform frameworks, components and templates enabling future development efficiencies
Knowledge transfer throughout the organization via participation in CoPs, appropriate documentation and internal presentations establishing thought leadership and capability excellence on client’s platform
SkillCompetency Requirements:


Experience building batch data pipelines and applications in a production environment
Experience with functional programming techniques
Experience in Test Driven Development or Behaviour Driven Development
Experience in logical and physical data modelling across structured, semi-structured and unstructured data technologies
Software testing and release cycle experience
Excellent communications skills and a team player

SQL and relational database skills MS SQL Server, Oracle, etc
Proficiency with Cloud providers, preferably Azure, alternatively AWS, GCP, etc.
Ability to express real-world processes in the languages of mathematics and probability
Agile delivery experience including Scrum, Kanban, SAFe
Additional skills:

Domain expertise in finance, credit risk, fraud, and or marketing
Proficiency with data visualization libraries Bokeh, Matplotlib, d3.js
Machine learning or data science engineering experience.

EOE/Minority/Female/Veteran/Disabled/Sexual Orientation/Gender Identity.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.