Are you a talented and driven Data Engineer? Join our multiyear Commodities and Global Markets data transformation programme and play a key role in this transformative project.

Our Commodities and Global Markets Data Transformation is an exciting program of work as we embark on our journey to build the innovative and future ready Data Platform that will help Macquarie businesses meet their customer’s needs.

We are searching for a Big Data Engineer to join us in our Engineering team and to develop cutting-edge applications. We are industry pioneers and we actively look for innovative ways to achieve great results, which do speak for themselves:

We need you to have:

• strong Data Warehousing experience with emphasis on Information management domain

• strong Data Modelling experience

• experience on NoSQL Database like HBase, Cassandra, MongoDB , Druid
• strong Linux/Unix skills
• prior working experience with AWS - any or all of EC2, S3, EBS, ELB, RDS, Dynamo DB, EMR, Apache Parquet
• strong SQL experience
• Big Data Querying tools like Hive, Spark, Presto
• exposure to working in an Agile environment
• trouble shoot and resolve production issues under a DevOps model
• continuously identify opportunities to improve the performance and quality of platform
• monitor performance and ensure infrastructure is appropriately matched to support workload and SLA’s
• broad knowledge of technical solutions, design patterns, and code for medium/complex applications deployed in clustered computing environment.

Ideally you will have:

• good experience in programming languages like (Scala or Java or Python) in context of Big data technologies like Spark
• Docker, Kubernetes, Openshift
• exposure to Security Concepts and best practices
• data Pipelines tools like Apache oozie, LUIGI or Airflow
• Maven, SBT
• machine learning (E.g. Spark ML or R)
• real time integration (using Kafka, Spark streaming or other technologies)
• experience with Flink, Beam
• experience with various messaging systems, such as Kafka ,RabbitMQ ,Solace
• a good understanding of Lambda Architecture, along with its advantages and drawbacks
• experience and knowledge of major Hadoop distribution such as Cloudera, MapR, Hortonworks HDP would be beneficial.
• good experience with build tools like Maven, Gradle, Ant
• API based integration.

If this role sounds like the right opportunity to further your career, please apply via the link.

About the Corporate Operations Group

The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Market Operations, Human Resources, Business Services, Business Improvement & Strategy, and the Macquarie Group Foundation. The Corporate Operations Group’s purpose is to power the entrepreneurial enterprise.

Our commitment to Diversity and Inclusion

Macquarie understands the importance of diversity and inclusion - our long history of success has come from being different. At Macquarie we value the innovation and creativity that diversity of thought brings. The one thing we all have in common is our focus on high performance. If you're capable, motivated and can deliver, we want you on our team.

Macquarie is an equal opportunities employer and does not discriminate on the grounds of age, disability, sex, sexual orientation, gender reassignment, gender identity, marriage, civil partnership, pregnancy, maternity, race (including colour and ethnic or national origins), religion or belief.

We recognise that flexibility comes in a variety of forms. Talk to us about what flexibility you need.

About Macquarie

The best investment you can make is in yourself.

Whether you’re looking to take on a new project; progress within your division; explore an opportunity in a different team; or relocate globally – we let our people decide which direction they want to take.

At Macquarie we uncover the opportunities others may miss. Our culture promotes innovation, balanced with robust risk management, to realise opportunity for our clients, community, shareholders and our people.

Macquarie is a diversified global financial group providing clients with asset management, banking, advisory and risk and capital solutions across debt, equity and commodities. Headquartered in Sydney and with offices in 31 markets, it is the breadth of our operations, combined with a strong capital position and risk management framework, that has contributed to our 51-year record of unbroken profitability.

Job no: COG-953370
Work type: Full time
Location: Sydney
Category: Senior, Technology
Group: Corporate Operations Group
Division: Technology
Recruiter: Jon Grant
Opening Date: 28/5/2020