Your new organisation: We are currently partnering with a leading consultancy to source for numerous data roles that will be working onsite at a “big 4” bank on some exciting projects.
Big Data Engineer are responsible for developing, testing, implementing, and maintaining big data solutions and data pipelines for data lake environment with the ,ability to design solutions independently based on high-level architecture .
What you'll need to succeed:
Big Data/Data Lake technologies such as Hortonworks, Cloudera etc
Hands on experience working on Spark, Python
Hands on experience working on Cloud Technologies, preferably Microsoft Azure
Data storage services such as HBase, Hive, HDFS etc
Exposure to both batch and real time processing
Data management services such as Atlas, Cloudera Navigator etc
Good understanding of basic scheduling mechanism such as Control M
Understanding of overall data domain and related concepts of Data Modelling, Data Lineage, Metadata Management
What you need to do now: Please apply or to find out more about this exciting opportunity, please ,contact Menka on 0292492265 or email to email@example.com [mailto:firstname.lastname@example.org] for a detailed and confidential discussion .