Kuberno

Data Engineer ETL (Azure Data Factory)

Job description

Data Engineer ETL (Azure Data Factory)

Company Overview

Kube is Kuberno’s unique entity governance platform. It provides a definitive source of entity data and automates entity governance across businesses. (An limited company is just one type of “entity” … just in case you were wondering! But don’t worry if you didn’t know that – we love sharing our knowledge and experience of governance and can get you up to speed in no time!).

Kube has been built around Kuberno’s customers. Our onboarding team support our new customers with bringing their corporate data into Kube and come equipped with a deep knowledge of Kube and a design-thinking approach employing empathy and creative problem-solving.

We don’t have a check list of skills or experience for this role. We are looking for teamwork, aptitude, and attitude, but you will be expected to hit the ground running in a fast-paced environment. Being a self-starter, highly motivated and wanting to be part of the team culture is key.

Job Overview

We are seeking a highly skilled and experienced Data Engineer with expertise in ETL (Extract, Transform, Load) processes using Azure Data Factory. As a Data Engineer ETL, you will be responsible for designing, developing, and maintaining data pipelines that efficiently and accurately move and transform data from various sources into a centralized data warehouse. We are open to discussing a permanent or contract opportunity.

Responsibilities

  • Designing and implementing end-to-end ETL processes using Azure Data Factory to extract data from multiple sources, transform it to meet business requirements, and load it into a data warehouse.
  • Collaborating with cross-functional teams to understand data requirements, business rules, and data quality standards to ensure accurate and consistent data delivery.
  • Building and maintaining scalable and efficient ETL pipelines that handle large volumes of data while adhering to best practices for data integration and data governance.
  • Developing and implementing data validation and reconciliation processes to ensure data accuracy and consistency across all data sets.
  • Troubleshooting and resolving issues related to data transformation, data loading, and data quality, while proactively identifying opportunities for process optimisation and performance tuning.
  • Collaborating with data architects, data scientists, and other stakeholders to understand data models and data requirements to support data exploration, analytics, and reporting initiatives.
  • Documenting and maintaining technical specifications, data pipeline documentation, and data lineage to ensure data governance and regulatory compliance.
  • Staying up-to-date with the latest industry trends and technologies related to Azure Data Factory and ETL to continuously improve data engineering practices and solutions.

Requirements

  • Strong expertise in SQL and experience with data integration, data transformation, and data loading techniques using ETL tools and frameworks.
  • Hands-on experience with cloud platforms, preferably Microsoft Azure, including familiarity with Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Databricks.
  • Proficiency in programming languages such as Python, R, Powershell, for data processing, data manipulation, and data transformation.
  • Knowledge of data modeling concepts and experience with data modeling tools is a plus.
  • Excellent problem-solving skills, with the ability to analyze complex data scenarios and design efficient and scalable solutions.
  • Strong communication and collaborative skills, with the ability to work effectively in cross-functional teams and communicate technical concepts to both technical and non-technical stakeholders.

Location:

The role will primarily be home-based, but you should be willing and able to travel to London for a day on a monthly basis for team meetings. You may also be required to travel to customer sites for face-to-face meetings. These would typically be ad-hoc and set up at the request of the customer.

Still Holding Back?

Confidence can sometimes hold us back from applying for a job. But we will let you into a secret: There’s no such thing as a “perfect” candidate! Kuberno is a place where everyone can grow. So however you identify and whatever your background, please apply if this is a role that would make you excited to be at work every day.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Noesis
July 27, 2024

Data Engineer (m/f)

Standard Chartered
July 27, 2024

Junior Business Data Engineer

Materialise
July 27, 2024

Data Engineer