BNY Mellon

Senior Big Data Engineer

Job description

Overview

Our Team

Technology Services Group (TSG) keeps BNY Mellon's technology running and defines and executes the firm’s technology strategy, positioning us for tomorrow. From the computers and collaboration tools of our employees to modernized infrastructure platforms and core services, we ensure that the firm’s systems are running optimally while enabling business innovation and productivity. We also oversee BNY Mellon’s architecture and data, guiding the firm through technology changes necessary to execute business strategies.

TSG Engineering engineers stable, scalable and robust infrastructure for the firm and leads the strategy of the company’s integrated engineering solutions.

The Role

TSG Database Engineering is building the next generation of big data platforms such as Cloudera CDP, MongoDB Ops Manager and PostgreSQL v13. Building on top of our DBaaS automation to efficiently deploy big data services, we are aggressively strengthening our database services and safeguard our data layer resiliencies.

We’re looking for a Senior Big Data Engineer with proven Cloudera Hadoop product expertise and engineering skillset.

You will design and create highly complex big data/Hadoop platforms. You will have expert knowledge in distributed datalake systems. You’ll configure and tune service components to optimize platform performance. You will design and implement backup and restore strategies and disaster recovery solutions. You will support and troubleshoot performance related issues. You’ll consult with storage and host engineering services to create optimized big data ecosystems.

You’ll develop trusted corporations with application tenants. You’ll advise applications with sounds data layer resiliencies. You’ll provide input into the selection of tools and any necessary migration into the company's environment.

Responsibilities:
Work as a senior system engineer for the Hadoop enterprise data platform

platforms

Assist in cross-team collaboration and design discussions

Provide sandbox functionality to users of the datasets to assist application analytics

Provide storage infrastructure system management including capacity planning, performance monitoring and tuning, security management etc.

Responsible for infrastructure Support and projects including system design, planning, installations, configurations, upgrades and planning.

Manage Tier-3 support following ITIL practice and incident management

Manage system configurations and solutions, and monitor the full lifecycles of storage area network (SAN) administration, architecture, and support.

Data storage tasks such as management, provisioning, troubleshooting and debugging

Lead technical assessments of hardware, software, tools, applications, firmware, and operating systems to support business operations.

Qualifications

Bachelor's degree in computer science or a related discipline, or equivalent work experience required, 5-10 years of experience in Hadoop technologies, data lake design, experience in the securities or financial services industry is a plus.

Excellent knowledge with Hadoop components for big data platforms related to data ingestion, storage, transformations and analytics

Excellent DevOps skillsets and SDLC practices

Excellent knowledge of automation tools such as Ansible

Must have Python programming skills

Excellent knowledge of Docker containers

Collaborate with other developers and architects to enhance the capabilities of the platforms

Assist in cross-team collaboration and design discussions

Provide sandbox functionality to users of the datasets to assist application analytics

Knowledges of Kerberos, REST APIs are a plus

Desired Skills:
8+ years of experience on BigData Platform on Hadoop, Spark, Hive, HBase

3+ years’ experience on Python and DevOps tools such as Ansible

Strong Agile/Scrum development experience

Strong collaboration and communication skills within distributed project teams

Excellent written and verbal communication skills

Passion to stay on top of the latest happenings in the tech world and an attitude to discuss and bring those into play.

Working knowledge with PostgreSQL or Mongo DB databases a plus

BNY Mellon is an Equal Employment Opportunity/Affirmative Action Employer. Minorities/Females/Individuals with Disabilities/Protected Veterans. Our ambition is to build the best global team – one that is representative and inclusive of the diverse talent, clients and communities we work with and serve – and to empower our team to do their best work. We support wellbeing and a balanced life, and offer a range of family-friendly, inclusive employment policies and employee forums.

This person is a subject matter expert in several of the tools/technologies used in the space.Leads the development infrastructure engineering growth strategies and initiatives. Leads initiatives to analyze complex infrastructure problems to be solved with advanced design.Leads the evaluation of the effectiveness of the organization's existing infrastructure technology and tools. Analyzes trends to develop strategy for the implementation of upgrades that will enhance the reliability, Resiliency and efficiency of the IT infrastructure.Provides leadership to execute project plans and performance requirements for all stages/phases through the management of human capital resources.This person is a subject matter expert in at least one of the tools/techologies used in the space.Participates in or leads initiatives to analyze infrastructure problems to be solved with advanced design. Utilizes standard procedures and policies when selecting methods, techniques, and evaluation criteria for obtaining results.Participates in or leads initiatives to analyze infrastructure problems to be solved with advanced design. Utilizes standard procedures and policies when selecting methods, techniques, and evaluation criteria for obtaining results.Manages the processes for ensuring that all systems/applications/software/hardware are compliant with Corporate policy/procedures.Monitors project plans and budgets.Works closely with external vendors, internal partners and busienss teams to provide infrastructure/tool needs.Works with Application Development and Quality Assurance, Testing and Business teams to understand infrastructure needs during the development, testing and production BAU processes. Ensures these needs are taken into account when developing infrastructure.Acts as escalation point for major incidents.Leads strategy to increase automation across the organization.Contributes to the achievement of multiple teams' objectivesBachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred10-12 years of related experience required; experience in the securities or financial services industry is a plus. BNY Mellon is an Equal Employment Opportunity/Affirmative Action Employer. Minorities/Females/Individuals with Disabilities/Protected Veterans. Our ambition is to build the best global team – one that is representative and inclusive of the diverse talent, clients and communities we work with and serve – and to empower our team to do their best work. We support wellbeing and a balanced life, and offer a range of family-friendly, inclusive employment policies and employee forums.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.