Big Data Engineer

Big Data Engineer – Defence & National Security
📍 Full-time, On-Site | 💷 £77,400 – £116,000 | UK Citizenship & Highest Level Clearance Required | 🧳 Relocation Assistance Available

Work at the cutting edge of national security and big data innovation.

My client is seeking an experienced Big Data Engineer to help design, implement, and optimise scalable data systems that support critical AI, ML, and data science operations in a secure, mission-focused environment. This is a high-impact, high-trust role, supporting the UK’s most sensitive digital transformation programmes.

🔧 Key Responsibilities:

Automate and troubleshoot complex data workflows using tools like NiFi and Airflow

*

Design secure, scalable data systems with GDPR and privacy in mind

*

Integrate and maintain big data platforms like Hive, Impala, and Elasticsearch

*

Support hybrid cloud infrastructure (on-premise + AWS)

*

Enable AI/ML environments using tools such as Jupyter, Spacy, and Transformers

*

Use BI tools like Tableau, Kibana, and PowerBI for reporting and insight delivery

*

Collaborate across engineering and data science teams to deliver high-impact outcomes

✅ You’ll Need:

*

Strong scripting and Linux system administration skills

*

Deep understanding of TCP/IP, OSI models, and network troubleshooting

*

Experience with NoSQL databases and big data architectures

*

Track record supporting AI/ML pipelines in regulated or secure environments

*

Excellent problem-solving and integration testing skills

🌟 Desirable:

*

AWS/cloud certifications

*

Experience with Cloudera, Hadoop, CDSW, or CML

*

Background in defence, intelligence, or highly regulated industries

🎯 Why Apply?

*

Be part of a mission with real national impact

*

Competitive salary & benefits

*

Supportive team, with access to cutting-edge tools and training

*

Work on-site with some of the most advanced data systems in the UK

Define what’s possible. Apply now and help build the future of secure data in defence