Big Data Engineer

Job description

BIG Data Engineer

Your new organisation: We are currently partnering with a leading consultancy to source for numerous data roles that will be working onsite at a “big 4” bank on some exciting projects.

Big Data Engineer are responsible for developing, testing, implementing, and maintaining big data solutions and data pipelines for data lake environment with the ,ability to design solutions independently based on high-level architecture .

What you'll need to succeed:

  • Big Data/Data Lake technologies such as Hortonworks, Cloudera etc
  • Hands on experience working on Spark, Python
  • Hands on experience working on Cloud Technologies, preferably Microsoft Azure
  • Data storage services such as HBase, Hive, HDFS etc
  • Exposure to both batch and real time processing
  • Data management services such as Atlas, Cloudera Navigator etc
  • Good understanding of basic scheduling mechanism such as Control M
  • Understanding of overall data domain and related concepts of Data Modelling, Data Lineage, Metadata Management

What you need to do now:
Please apply or to find out more about this exciting opportunity, please ,contact Menka on 0292492265 or email to menka.tahiliani@hays.com.au [mailto:menka.tahiliani@hays.com.au] for a detailed and confidential discussion .

LHS 297508 #2555456

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.