Data Engineer

Company:
Location: Remoto

*** Mention DataYoshi when applying ***

Descrição da empresa

Our mission is to build an efficient and transparent hiring
model that enables teams to scale at ease.



Atividades e Responsabilidades

The Data Engineering Team at Coinsquare is looking for a Data Engineer to contribute towards creating their data and analytics infrastructure. On this journey, you will work on cutting edge Fintech projects and become highly skilled in data wrangling, cloud architecture, Python libraries, Kafka, SQL and the Digital Currency domain. You’ll be reporting to the Director of Data Engineering and working closely with a world class team of Software Engineers, Product Professionals, Dev Ops Engineers, Business Managers, Compliance and AML teams.
What you will do:
Build fault tolerant, high throughput data pipelines from internal and external data stores and into the data lake
Analyze Data sets for anomalies, implement robust data quality measures in code and mitigate data infrastructure down time.
Incorporate and enforce data governance policies in daily operations while working closely with the AML and Compliance teams
Understand the development processes, styles and guides within the Data Team and minimize technical debt by writing clean, portable, modular, well documented and tested code.
Work closely with the Dev-Ops team to manage application deployments to the Kubernetes clusters
Monitor and Understand logs through Kibana or Prometheus to identify root causes of errors and provide suggestions for fixes
Create Kafka Workers which interact with the application layer
Gain an insight into the Digital Currency data sets, operations and nuances. Understand financial reports, understand the stakeholders and understand the reporting requirements.



Requisitos

Ideal candidates will have:
Have strong SQL skills
Strong development experience with python projects having used Pandas, SqlAlchemy, NumPy, comfortable enough to demonstrate during an interview
Have extensively used git and be able to effortlessly navigate through git commands to create source controlled projects hosted on github
Have a working knowledge of Cassandra and Postgres Databases
Have used the Docker ecosystem to develop containerized applications
Have incorporated rigorous testing and refactoring within your development style
Understand various data structures such as list, dictionary, maps, resultsets and be able to use the appropriate one to solve a problem
Have used VSCode for development and feel at home in software development using Agile and Kanban methodologies
Huge bonus for any exposure and work with:
Kubernetes deployments
Kafka topics and distributed computing
Have a used AWS components such as AWSCLI, S3 buckets, permissions, IAM, AWS keys
Please send you CV in English to apply.

*** Mention DataYoshi when applying ***

Offers you may like...

  • UnitedHealth Group

    Senior Data Engineer Data Quality Analyst - Teleco...
    Eden Prairie, MN 55346
  • Business Mentors

    Senior Data Engineer FT
    Remote
  • umlaut North America

    Staff Data Engineer
    Remote
  • Recruiting for Good

    Remote Data Engineer with Cool Automotive Company
    Los Angeles, CA
  • XO

    Data Engineer
    Brisbane, CA 94005