Data Engineer

Experience: 10+ Years

Role: Data Engineer

Key Skills

Linux, Shell Script, Java Script, Jboss, Maria DB, Hadoop / Hive / HBase / HDFS, Firewall, Networking and System Integration\

Key Responsibilities

• Participate in end-to-end projects for system implementation of MLS system and integrate with other upstream and downstream systems
• Engage and collaborate with Architects, Security and Development Lead to ensure solution design complies with enterprise design principles, security, and control standards
• Coordinate with Technical Delivery Manager to plan technical deliverables and schedule, perform environment installation, configuration and setup, involve in solution design and development works to meet project requirements
• Escalate issues that impacts project schedule on timely basis and propose workarounds/resolutions
• Create technical documents for the solutions. Compile timely, comprehensive, and accurate documentation as requested
• Implement project change request and in accordance with deployment schedule
• Partner with Test Management teams to ensure completion of SIT, UAT, Mock Run, performance / load testing and application security testing with quality result
• Facilitate and provide technical and testing support before and after production deployment
• Liaise with other units across IT and Business in the organization.
  
  

Key Requirements

Must Have

• At least 8 years of experience / knowledge in Red Hat Linux, Unix Shell Scripting, Java, Jboss to perform installation, upgrade, troubleshooting, connection and integration
• At least 4 years of experience in Cloudera Hadoop/Hive/HBase/HDFS, Yarn, MapReduce, Spark, Sqoop, System Interfaces (SFTP, FTP, API, Rest, SOAP), environment setup and troubleshooting
• At least 4 years of experience of coordination with cross technical teams
• At least 4 years of experience in SQL, MariaDB/Oracle, NoSQL, Jenkins/DevOps CI-CD, Control-M
• At least 4 years of experience in Bitbucket / Git
• Ability to multitask effectively and handle large amounts of data includes data ingestion and processing
• Ability to setup, manage Hadoop cluster configuration, parameters, resource allocation, monitoring and troubleshooting
• Ability to resolve authentication, authorization, encryption issue among Hadoop, 3-tier architecture and LDAP
• Highly driven, pro-active and a strong team player
• Excellent interpersonal skills and written and verbal communication skills in English
  
  

Good to Have

• Knowledge of networking, firewall, VPN, SSL, Kerberos, load balancing, and high availability
• Experience in MS Teams, MS SharePoint, MS Office, JIRA, Aldon, Confluence, and Remedy
• Experience in Python, Data Engineering, Data warehousing and analytics.