Cybertec, Inc

Data Engineer

Job description

Role- Data Engineer

Location- Mississauga, ON, Montreal, QC (Hybrid)

Need- Data bricks, Pyspark, Sql

Responsibilities

Experience of designing and implementing an operational production grade large-scale data solution on Microsoft Azure some experience on Snowflake Data Warehouse.

Including hands on experience with productionized data ingestion and processing pipelines using Python, Data bricks, Snow SQL

Excellent understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies

Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.

Skill set

  • Databricks
  • Architecture
  • Unity Catalog
  • Delta lake tables
  • Auto Loader
  • Delta Live Tables
  • Single/Multiple csv files data ingestion
  • SCD Type1, type2 implementation
  • Azure Services:
  • ADLS Gen2
  • Blob storage configuration
  • Key vault
  • Databricks
  • ADF
  • SQL:
  • All Analytical/Window functions
  • CTE
  • Subqueries
  • Constraints
  • Joins
  • Union/Union All
  • SCD Type1 and Type2 implementation
  • Datawarehouse:
  • Dimensional modelling
  • SCD Types

Thanks & Regards

Lokesh Sharma

Team Lead - Recruitment

Cybertec, Inc.

lokesh@cy-tec.com

LinkedIn: https://www.linkedin.com/in/lokesh-sharma-1541a3162/

11710 Plaza America Drive Suite #2000, Reston, VA 20190

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Progressive Edge
May 27, 2024

Data Engineer & Analyst

KIT-AR
May 27, 2024

Senior Data Engineer

KIT-AR
May 27, 2024

Senior Data Engineer