London-Based Company - up to £75k Hybrid working Our client, a not-for-profit energy organisation, is now looking for a Senior Data Engineer. The business work in a close relationship with the government and is integral to the economy, your role will be vital in improving the functionality of the highly regulated environment. This new opportunity has been created to support a currently established team to take them to the next level. As the Senior Data Engineer, you will focus on data and integration, ensuring that they drive a single version of the truth by developing and maintaining reliable solutions to store and manage critical data. What’s in it for you? Hybrid working available
3 days office/2 days home 8% Employer Pension Contribution 25 days annual leave Family-friendly policies Access to work perks Recognition Schemes Job Duties and Responsibilities of the Senior Data Engineer: Own, design, develop and maintain databases and Datawarehouse Source, model and provide reliable data in a form that is ready for report/dashboard building Drive better data governance through the creation and embedding of principles and processes Build and maintain key data governance and management artefacts e.g., Logical Data Model & Flow Diagram, Data Dictionary, and KPI Catalogue. Define the overall approach and data flow forExtract, Transform and Load; and application of this for a given deployment/project Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load Design and implement data models within a data warehouse Write ETL data validation and data reconciliation queries Define high level and low-level design of a data warehouse to ensure robustness Define, embed, and drive master data management approaches, principles, and processes Identify data quality issues through data profiling, analysis, and stakeholder engagement Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support. Skills/attributes required: At least 4 years experience in Microsoft Azure Datawarehouse architecture as well as Data Warehousing tools and database systems Experience with ETL and ELT processes, working with database architecture and business intelligence tools Experience with database administration Able to develop and optimise queries in SQL Experience in creating data pipelines using Azure Data Factory Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience in writing PowerShell scripts Able to work with large datasets and extrapolate conclusions Click on Apply now