BL Consultants

AWS or Azure - Data Engineer - Databricks - Pyspar...

Job description

Senior Data Engineer with experience in both AWS and Azure Databricks includes the following responsibilities:

  • Collect, analyze, and report on structured and unstructured data from multiple sources
  • Design and build data pipelines, reporting tools, information dashboards, and other end-user information portals
  • Ensure stakeholders can access and manipulate data for routine and ad hoc analysis
  • Work and communicate proactively with team members, technical leads, and project managers
  • Use modern data engineering techniques and methods with Advanced Analytics to support business decisions for clients
  • Strong experience as an AWS and Azure Data Engineer with AWS and Azure Databricks experience
  • Expert proficiency in Python, PySpark, and other programming and scripting languages
  • Hands-on experience with AWS and Azure data lake and analytics solutions, Kinesis, DynamoDB, Event/IoT Hubs, and Cosmos
  • In-depth understanding of AWS and Azure cloud services and technologies
  • Experience preparing data for data science, machine learning, and AI use cases
  • Strong understanding of data modeling and defining conceptual, logical, and physical data models
  • Working knowledge of RESTful APIs, OAuth2 authorization framework, and API security best practices
  • Strong written and verbal communication skills
  • Ability to manage competing priorities in a fast-paced environment
  • Self-motivated and able to work independently


  • 2+ years of hands-on experience designing and implementing multi-tenant solutions using both AWS and Azure Databricks
  • 5+ years of experience in software development, data engineering, or data analytics
  • Bachelor's or master's degree in a relevant field or equivalent work experience
  • Ability to resolve issues
  • Microsoft Certified: Azure Data Engineer Associate (nice to have)

This job is provided by

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.