Job description

Experience: 10+ Years

Role: Data Engineer

Key Skills

Linux, Shell Script, Java Script, Jboss, Maria DB, Hadoop / Hive / HBase / HDFS, Firewall, Networking and System Integration\

Key Responsibilities

  • Participate in end-to-end projects for system implementation of MLS system and integrate with other upstream and downstream systems
  • Engage and collaborate with Architects, Security and Development Lead to ensure solution design complies with enterprise design principles, security, and control standards
  • Coordinate with Technical Delivery Manager to plan technical deliverables and schedule, perform environment installation, configuration and setup, involve in solution design and development works to meet project requirements
  • Escalate issues that impacts project schedule on timely basis and propose workarounds/resolutions
  • Create technical documents for the solutions. Compile timely, comprehensive, and accurate documentation as requested
  • Implement project change request and in accordance with deployment schedule
  • Partner with Test Management teams to ensure completion of SIT, UAT, Mock Run, performance / load testing and application security testing with quality result
  • Facilitate and provide technical and testing support before and after production deployment
  • Liaise with other units across IT and Business in the organization.

Key Requirements

Must Have

  • At least 8 years of experience / knowledge in Red Hat Linux, Unix Shell Scripting, Java, Jboss to perform installation, upgrade, troubleshooting, connection and integration
  • At least 4 years of experience in Cloudera Hadoop/Hive/HBase/HDFS, Yarn, MapReduce, Spark, Sqoop, System Interfaces (SFTP, FTP, API, Rest, SOAP), environment setup and troubleshooting
  • At least 4 years of experience of coordination with cross technical teams
  • At least 4 years of experience in SQL, MariaDB/Oracle, NoSQL, Jenkins/DevOps CI-CD, Control-M
  • At least 4 years of experience in Bitbucket / Git
  • Ability to multitask effectively and handle large amounts of data includes data ingestion and processing
  • Ability to setup, manage Hadoop cluster configuration, parameters, resource allocation, monitoring and troubleshooting
  • Ability to resolve authentication, authorization, encryption issue among Hadoop, 3-tier architecture and LDAP
  • Highly driven, pro-active and a strong team player
  • Excellent interpersonal skills and written and verbal communication skills in English

Good to Have

  • Knowledge of networking, firewall, VPN, SSL, Kerberos, load balancing, and high availability
  • Experience in MS Teams, MS SharePoint, MS Office, JIRA, Aldon, Confluence, and Remedy
  • Experience in Python, Data Engineering, Data warehousing and analytics.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs