Big Data Engineer – Hadoop

Company:
Location: Łódź, łódzkie

*** Mention DataYoshi when applying ***

Paid vacation: 26

Skills
Big Data - Excellent
Hadoop - Excellent
ETL - Excellent

Your tasks
Act as a functional lead and SPOC for the requirement and delivery management towards the main customer team based in Frankfurt (only for Senior Developer)Development, implementation and maintenance of the Compliance Data Lake solution on basis of the Hadoop-Big Data-Platform using the DP CSA CAMP (Compliance agile solution-based) on a domain-specific language.Creating packages for software deployment and test using CAMP as well as integration into the Compliance specific framework based on JAVA development on SparkSQL of the HDP Big Data Hadoop platformSupport testing including error analysis and QA measures and apply fixes accordingly as part of 3rd level supportSupport of continuous improvement and optimization of the Software Lifecycle Processes including CAMP and CI/CD solutions

Who we're looking for?

Expectations:
Experience in implementing ETL solutions and processing Frameworks on HDP Hadoop Big Data solutions
Implementing and maintenance of the compliance specific Framework CSA on Hadoop using Spark Framework
Implementation and maintenances of Big Data Solutions using Hive, Sqoop, Spark, Scala & Kafka, etc.
Good knowledge of Agile tools&methods (Jira, Kanban+Scrum, CI/CD processes)
English B2 level - mandatory

Alternative Skills:
Basic knowledge, or willingness to learn Domain-specific language (DSL)
Basic knowledge, or willingness to learn of UC4/Automation one
Basic knowledge, or willingness to learn of Banking Compliance business topics, such as Anti Money Laundering, Customer Due Diligence, KYC Scoring and Watch List Filtering
German - nice to have

Project description
You will be responsible for the continuous development, Implementation and Maintenance of the Commerzbank Compliance Data Lake on the central Hadoop Platform witch is one of the foundations of Commerzbank 4.0 Transformation to a digital technology company.

*** Mention DataYoshi when applying ***

Offers you may like...

  • SII Deutschland GmbH

    DATA ANALYST BIG DATA (m/w/d)
    85055 Ingolstadt
  • Disys India Private Limited

    Big Data/Machine Learning Engineer - Lead
    United States
  • Commerzbank AG – Poland

    Big Data Engineer – Hadoop
    Łódź, łódzkie
  • Citi

    Sr Big Data Engineer Irving/Tampa C13 (R2037063)
    Tampa, FL
  • Bmtech group

    Senior Big Data Engineer
    Austin, TX