Data Engineer

Please Note: As of July 22, 2021, our team will require that all candidate submissions include a LinkedIn profile. Please do not submit any candidates that do not have a LinkedIn.

iLabor Jobs Details Full Job Description NA is hiring two Data Engineers for a local Cincinnati, OH client for a 6+month engagement. The Data Engineers will be required to be onsite 2-3 days per week.

Responsibilities

• Data Engineers develops ELT processes and frameworks to efficiently extract, load, and transform data from various sources
• Partners with DevOps to design and build scalable, automated CI/CD pipelines using Harness and GitHub
• As a Data Engineer, you will monitor and optimize the performance of data pipelines to ensure high data quality and availability
• Responsible for the physical data structures, data integration, build, and care of solutionsVisa Restrictions
  
  

Locals Only/ Out of Area/ Remote Interview Type (Phone, Video, Face to Face) VideoAnticipated Start (in weeks) 2 3-5 Must Haves They are looking for a data engineer with 5-8 years of experience in Azure Data Factory, Databricks, and Unity Catalog

Required Skills : * Bachelor's degree in computer science or engineering-related field or equivalent work experience * Data Engineer: between 5 and 8 years in data engineering with a focus on batch and streaming data * Professional experience Hands-on data engineering experience with Azure cloud data ecosystem components: * Azure Data Factory * Databricks * Unity Catalog * Understanding of Medallion architecture * Understanding and familiarity with Delta Live tables * Hands-on experience with Kafka strongly preferred * Experience delivering software on at least 2 projects with a total project team size greater than 4 team members * Strong SQL writing and optimizing skills * Strong proficiency in Python * Expertise and professional experience with Kafka streams * Experience creating synthetic test data for data pipelines * Experience with workflow orchestration/scheduling solutions * Solid understanding of modern cloud-based data architecture, ELT processes, and real-time data processing * Must be able to work independently with minimal supervision and assistance * Able to troubleshoot and resolve issues in data pipelines * Nice-to-have experience implementing observability solutions

Rank :B1

Requested Date :2024-04-23