National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer (SC cleared)

City of London
3 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer
4 months - with extensions
Remote
Active SC clearance required
£640 per day inside ir35

REQUIRED

Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc
Strong understanding of complex JSON manipulation
Experience working with Data Pipelines using a custom Python/PySpark frameworks
Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets
Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve)
Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc)
Fundamental linux system administration knowledge - ssh keys and config etc, Bash CLI and scripting, Environment variables
Experience using browser based IDEs (Jupyter Notebooks, RStudio etc)
Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc)
Python (as a programming language, not just being able to write basic scripts)LANGUAGES / FRAMEWORKS

JSON
YAML
Python (as a programming language, not just able to write basic scripts)
Pydantic experience DESIRABLE
SQL
PySpark
Delta Lake
Bash (both CLI usage and scripting)
Git
Markdown
Scala DESIRABLE
Azure SQL Server as a HIVE Metastore DESIRABLETECHNOLOGIES

Azure Databricks
Apache Spark
Delta Tables
Data processing with Python
PowerBI (Integration / Data Ingestion)
JIRAIf you meet the above requirements, please apply for the vacancy to be contacted by an Experis Consultant. If you haven't been contacted within 2 weeks of application, please consider the vacancy closed

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Find Hidden Machine Learning Jobs in the UK Using Professional Bodies like BCS, Turing Society & More

Machine learning (ML) continues to transform sectors across the UK—from fintech and retail to healthtech and autonomous systems. But while the demand for ML engineers, researchers, and applied scientists is growing, many of the best opportunities are never posted on traditional job boards. So, where do you find them? The answer lies in professional bodies, academic-industry networks, and tight-knit ML communities. In this guide, we’ll show you how to uncover hidden machine learning jobs in the UK by engaging with groups like the BCS (The Chartered Institute for IT), Turing Society, Alan Turing Institute, and others. We’ll explore how to use member directories, CPD events, SIGs (Special Interest Groups), and community projects to build connections, gain early access to job leads, and raise your professional profile in the ML ecosystem.

How to Get a Better Machine Learning Job After a Lay-Off or Redundancy

Redundancy in machine learning can feel especially frustrating when your role was technically advanced, strategically important, or AI-facing. But the UK still has strong demand for machine learning professionals across fintech, healthtech, retail, cybersecurity, autonomous systems, and generative AI. Whether you're a research-oriented ML engineer, production-focused MLOps developer, or applied scientist, this guide is designed to help you bounce back from redundancy and find a better opportunity that suits your goals.

Machine Learning Jobs Salary Calculator 2025: Figure Out Your True Worth in Seconds

Why last year’s pay survey is useless for UK ML professionals today Ask a Machine Learning Engineer wrangling transformer checkpoints, an MLOps Lead firefighting drift alarms, or a Research Scientist training diffusion models at 3 a.m.: “Am I earning what I deserve?” The honest answer changes monthly. A single OpenAI model drop doubles GPU demand, healthcare regulators release fresh explainability guidance, & a fintech unicorn pays six figures for vector‑search expertise. Each shock nudges salary bands. Any PDF salary guide printed in 2024 now looks like an outdated Jupyter notebook—missing the gen‑AI tsunami, the surge in edge inference, & the UK’s new Responsible‑AI framework. To give ML professionals an accurate benchmark, MachineLearningJobs.co.uk distilled a transparent, three‑factor formula that estimates a realistic 2025 salary in under a minute. Feed in your discipline, UK region, & seniority; you’ll receive a defensible figure—no stale averages, no guesswork. This article unpacks the formula, highlights the forces driving ML pay skyward, & offers five practical moves to boost your value inside the next ninety days.