Citi

Senior Data Engineer - AWS, Snowflake, Kafka, Spar...

Job description

Job Id: 22538646


We are looking for a Senior Data Engineer who is passionate about working with large scale, multi-tenant distributed data systems for users that expect a very high level of availability.


In this role, you will be responsible for creating AWS and Snowflake data pipelines, onboarding multiple use cases to AWS and Snowflake. You will also egress/migrate on-prem data from Oracle & Hadoop to AWS & Snowflake. You will also develop and support analytics solutions predominantly on Tableau & AWS tech stack. In addition to extracting and transforming data, you will have an opportunity to use your expertise to build data models, contribute to end to end architecture, develop design documents, build CI/CD pipeline, and write codified test cases.


Are you an engineer who is obsessed with code quality and has passion to bring fresh ideas in the areas of information retrieval, distributed computing, large-scale system design, data modelling & storage? Do you love to be part of a team that is building a very large-scale cloud native platform? If you answered yes, then you will fit right in.


The role reports to Senior Engineering Manager AWS – TTS Digital Experience.


What you ‘ll be doing:


  • Design and build efficient & reliable data pipelines to move and transform data.
  • Design data models for optimal storage & retrieval and integrate with enterprise Data Catalog to register metadata
  • Devise data quality checks to ensure high quality of data
  • Contribute to end-to-end data architecture and solutions
  • Write and review technical documents, including design, requirements, and process documentation
  • Research on new tools and technologies
  • Integrate with various products and tools which are part of Integrated Data Architecture
  • Develop data components and write codified controls as per the Integrated Data Architecture


What we are looking for:


  • 8+ years in software engineering, with strong fundamentals in distributed systems design and development
  • Experience in creating large scale data processing pipelines for streaming and computing with data technologies such as any of the following: AWS. Snowflake, Databricks, Kafka, Spark, Flink, Hadoop or similar
  • Good working knowledge of containers (Kubernetes/OpenShift/EKS or similar) and experience building cloud native applications that run on containers
  • Proficiency in at least one of the following programming languages: Java, Scala, Python, Go.
  • Enthusiasm and ability to pick up new technologies and concepts as necessary
  • Ability to communicate thoughtfully, demonstrating problem-solving skills and a learning mentality to build long-term relationships
  • Experience writing well structured, quality code that’s easily maintainable by others
  • Experienced in dealing with Sr audience and be able present technical material to non-technical stakeholders.


What the role offers you:


  • Working experience with building large scale data platforms, including establishing pipelines, building analytics solutions and AI/ML
  • Exposure to wide range of tools and technologies on Cloud, Streaming products, Hybrid data stores (Snowflake, AWS, Hadoop, MongoDB etc.,)
  • Opportunity to design and develop microservices architecture and API development
  • Exposure to DevSecOps practices to incorporate security first principles from the get-go
  • An opportunity to work multitude of cutting-edge tools and technologies


Citi Canada is an equal opportunity employer. Accordingly, we will make accommodations to respond to the needs of people with disabilities (including, without limitation, physical and mental health disabilities) during the recruitment process and otherwise in accordance with law. Individuals who view themselves as Aboriginals, members of visible minority or racialized communities, and people with disabilities are encouraged to apply.


-------------------------------------------------


Job Family Group:


Technology


-------------------------------------------------


Job Family:


Applications Development


------------------------------------------------------


Time Type:


Full time


------------------------------------------------------


Citi is an equal opportunity and affirmative action employer.


Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.


Citigroup Inc. and its subsidiaries (Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.


View the EEO is the Law poster. View the EEO is the Law Supplement.


View the EEO Policy Statement.


View the Pay Transparency Posting


Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Randstad Australia
December 5, 2022

Senior Data Analyst

Great Southern Bank
December 5, 2022

Senior Data Analyst