DDaT- Data Engineer

Do you want to work at the forefront of UK Defence, supporting operations that are beyond the reach, capability, and expertise of other armed forces?

We are a tri-service organisation that recruits the best of the armed forces and civilians to perform the most rewarding and complex tasks. We are recruiting exceptional individuals to support our activities tackling some of the most interesting and challenging national security issues in government. You will be working with unique, highly sensitive data, not seen elsewhere in defence, to the backdrop of a macro environment that is ever changing.

Some of the challenges you will face include working in mixed military and civilian teams to enable high risk operations by providing timely, accurate and trustworthy data and the development of cutting-edge capabilities.

This position is advertised at 37 hours per week.

You will be supporting the delivery of data products and capabilities used by our soldiers and marines on discreet military operations promoting the UK’s national interest across the globe. As our capabilities become ever more complex, consuming larger quantities of data, the effective, reliable, and scalable ability to process data into consumable products is essential.

The team in London is a mix of civilian, military personnel and contracted support working in collaboration with other teams across locations in the UK and overseas. We work across security classifications and have direct access to the operational users need.

We work closely with NATO, Five Eyes and other partners. There is opportunity for international travel to support operations within risk tolerance.

Some of the responsibilities you will take on include:

• Implement and automate data flows to connect operational systems and data for analytics to exploitation systems.
• Write scripts to extract, transform and load (ETL) data for ingestion and structure/format data for export around other parts of the business.
• Develop and implement data engineering best practice (source-to-target mapping, code standards, data quality, generating representative datasets etc.)
• Support and mentor other data engineers as well as develop your own skills.
• Setup and administer global policies for data.

Essential Criteria

• NiFi, Airflow and Azure Data Factory
• Python and Pandas
• SQL/NoSQL Databases (Neo4j, Elastic, Azure Blob)
• Messaging technologies such as Kafka
• Storage solutions such as Min-io or CEPH
• Experience of agile working
• Kubernetes (AKS and Kubernetes Engine)
• DevSecOps best practices, including source control (Git) and vulnerability scanning

Desirable Criteria

• AWS & Azure solutions for storage and data engineering, particularly tools available on Stack Hub
• Data analysis and visualisation tools such as Palantir, Tableau, PowerBi, TAK
• Familiarity with data governance and lineage practices

We'll assess you against these behaviours during the selection process:

• Seeing the Big Picture
• Delivering at Pace
• Changing and Improving
• Leadership

We'll assess you against these technical skills during the selection process:

• Data development process
• Data integration design
• Programming and build (data engineering)
• Problem resolution (data)

• Learning and development tailored to your role
• An environment with flexible working options
• A culture encouraging inclusion and diversity
• A Civil Service pension with an employer contribution of 28.97%

The post does not offer relocation expenses.

External recruits who join the MOD who are new to the Civil Service will be subject to a six-month probation period.

Please Note: Expenses incurred for travel to interviews will not be reimbursed.

Please be advised that the Department is conducting a review of all pay related allowances which could impact on those allowances that the post currently being advertised attracts.

Any move to MOD from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax-Free Childcare. Determine your eligibility at https://www.childcarechoices.gov.uk/.

The Ministry of Defence is committed to providing a safe and healthy working environment for its staff which includes educating them on the benefits of not smoking, protecting them from the harmful effects of second-hand smoke and supporting those who want to give up smoking. Under the Smoke-Free Working Environment policy, Smoking and the use of all tobacco products (including combustible and chewing tobacco products) will not be permitted anywhere in the Defence working environment however some exemptions are in place, please refer to local guidance. The policy is Whole Force and includes all Defence personnel, contractors, visitors and other non-MOD personnel. All applicants seeking, considering, or accepting employment with the Ministry of Defence should be aware of this policy and that it is already in place at a number of Defence Establishments.

MOD Recruitment Satisfaction Survey – We may contact you regarding your experience to help us improve our customer satisfaction. The survey is voluntary and anonymous. You may however be given the opportunity to provide additional information to help us improve our service which includes the collection of some personal data as defined by the United Kingdom General Data Protection Regulation (UK GDPR). The MOD Privacy Policy Notice sets out how we will use your personal data and your rights.

Job contact :

Name :
Recruitment Team
Email :
recruiting-group-mailbox-ldn@mod.gov.uk

Recruitment team

Email :
DBSCivPers-Resourcingteam3@mod.gov.uk