Lead Data Engineer

Searchability NS&D
Gloucester
7 months ago
Create job alert

3 days ago Be among the first 25 applicants

This range is provided by Searchability NS&D. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from Searchability NS&D

Lead Consultant placing Security Cleared DevOps, Cloud, Data, Cyber, and Infrastructure candidates in the Southwest

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester

  • Gloucester location – hybrid working when possible
  • Must hold active Enhanced DV Clearance (West)
  • Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus
  • Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership

Who Are We?

Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth.

What will the Lead Data Engineer be Doing?

You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to connect operational systems with analytics and business intelligence platforms.

Responsibilities include:

  • Design, build, and maintain data pipelines, including ingestion, orchestration, and enrichment
  • Develop data-streaming and ETL solutions (e.g. NiFi)
  • Model databases and integrate data from diverse sources
  • Ensure data quality, consistency, and security
  • Monitor and optimise system performance
  • Apply systems integration expertise within agile teams
  • Decompose user needs into epics and stories
  • Promote reuse of data flows and best practices across teams

The Lead Data Engineer Should Have:

  • Active eDV clearance (West)
  • Willingness to work full-time on-site in Gloucester when required.

Required experience in the following:

  • SQL and NoSQL databases (e.g. MongoDB)
  • ETL processing languages such as Groovy, Python or Java
  • Understand and interpret technical and business stakeholder needs
  • Manage expectations through clear, proactive communication
  • Lead and support challenging conversations with teams and senior stakeholders

To be Considered:

Please either apply by clicking online or emailing me directly to . For further information please call me on / - I can make myself available outside of normal working hours to suit from 7am until 10pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process & submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to follow me on Twitter @SearchableHenry or connect with me on LinkedIn, just search Henry Clay-Davies (searchability). I look forward to hearing from you.

KEY SKILLS:

DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

Seniority level

  • Seniority levelMid-Senior level

Employment type

  • Employment typeFull-time

Job function

  • Job functionInformation Technology and Consulting
  • IndustriesData Infrastructure and Analytics, Technology, Information and Media, and Information Services

Referrals increase your chances of interviewing at Searchability NS&D by 2x

Sign in to set job alerts for “Data Engineer” roles.

Gloucestershire, England, United Kingdom 4 days ago

Gloucestershire, England, United Kingdom 2 months ago

Worcester, England, United Kingdom 3 days ago

Gloucester, England, United Kingdom 4 hours ago

Worcester, England, United Kingdom 1 month ago

Stroud, England, United Kingdom 4 hours ago

Gloucester, England, United Kingdom 1 week ago

Gloucestershire, England, United Kingdom 4 days ago

System Reliability Engineer - Quantum Computing

Cambridge, England, United Kingdom 6 months ago

Software Support Engineer - Labyrinth Screening

Gloucester, England, United Kingdom 2 days ago

Gloucestershire, England, United Kingdom 1 week ago

Stroud, England, United Kingdom 3 weeks ago

Cambridge, England, United Kingdom 6 months ago

Cambridge, England, United Kingdom 1 month ago

Brockworth, England, United Kingdom 2 weeks ago

Research Software Engineer - Quantum Software

Cambridge, England, United Kingdom 2 months ago

Gloucester, England, United Kingdom 5 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.


#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data/Head of Data Engineer

Lead Data Engineer (AWS & Snowflake)

Lead Data Engineer - Newport NP10 8QQ

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

New Machine Learning Employers to Watch in 2026: UK and Global Companies Driving ML Innovation

Machine learning (ML) has transitioned from a specialised field into a core business capability. In 2026, organisations across healthcare, finance, robotics, autonomous systems, natural language processing, and analytics are expanding their machine learning teams to build scalable intelligent products and services. For professionals exploring opportunities on www.MachineLearningJobs.co.uk , understanding the companies that are scaling, winning investment, or securing high‑impact contracts is crucial. This article highlights the new and high‑growth machine learning employers to watch in 2026, focusing on UK innovators, international firms with significant UK presence, and global platforms investing in machine learning talent locally.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.