July 4, 2022
Apply Now
London, United Kingdom
July 4, 2022
Apply NowJob description
Senior Data Engineer
London
Hybrid
Consultancy
£70 000-£90 000
The Senior Data Engineer is responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers providing strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.
Most of our client's work comes through repeat business and direct referrals, which comes down to the quality of their people. The success of our Data Engineering teams means that customers are bringing our client's an increasing number of exciting data projects using cutting-edge technology to solve real-world problems. We are seeking more high calibre people to join their Data & Analytics capability where you will grow and contribute to industry-leading technical expertise.
Essential Experience
Desirable Experience
Does this role sound like a fit for you? Feel free to contact me at [email protected]
London
Hybrid
Consultancy
£70 000-£90 000
The Senior Data Engineer is responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Lead Data Engineers providing strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs.
Most of our client's work comes through repeat business and direct referrals, which comes down to the quality of their people. The success of our Data Engineering teams means that customers are bringing our client's an increasing number of exciting data projects using cutting-edge technology to solve real-world problems. We are seeking more high calibre people to join their Data & Analytics capability where you will grow and contribute to industry-leading technical expertise.
Essential Experience
- Minimum 3 years experience using: Scala OR Java OR Python
- Software development experience with distributed data storage and processing technologies including Hadoop and Spark and using JVM languages .
- Experience of leading the development of substantial components for large-scale data processing solutions, taking responsibility for non-functional needs of ETL/ELT data processing pipelines such as robustness, performance and security. ‘Development’ incorporates design, code, test defect resolution and operational readiness, and includes setting the standards for these activities.
- Coaching and mentoring experience in data development disciplines with the ability to gain the respect of a junior team.
- Ability to advise architects and other stakeholder on detailed technology and development practice and on development estimates.
- Ability to make effective decisions within fast-moving Agile delivery and to lead on troubleshooting.
- Strong understanding of tools, design methodologies and best practice.
- Ability to clearly communicate technical design both written and verbally.
Desirable Experience
- Software development experience with Cloudera’s distribution of Apache Hadoop and with Python .
- Experience of data visualisation and data complex data transformations, including ETL tools such as Talend.
- Able to productionise machine learning algorithms.
- Understanding of text processing including Natural Language Processing.
- Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture products.
- Data modelling experience with data storage technology, such as document, graph, log stores and other non-relational platforms.
- Open source contributor.
Does this role sound like a fit for you? Feel free to contact me at [email protected]
