Engineer the Quantum RevolutionYour expertise can help us shape the future of quantum computing at Oxford Ionics.

View Open Roles

Data Engineer

CSFI About CSFI Group
London
1 week ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Join to apply for the Data Engineer role at Cyber Security Forum Initiative

5 days ago Be among the first 25 applicants

Join to apply for the Data Engineer role at Cyber Security Forum Initiative

eSC Cleared Data Engineer

Bristol or London (Mostly working from home)

eSC Cleared Data Engineer

Bristol or London (Mostly working from home)

Up to £745 per day (Umbrella, Inside IR35)

Must hold live and transferrable Enhanced SC Security Clearance

About The Role

We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems.

If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact.

Key Responsibilities

  • Design & Optimise Pipelines - Build and refine ETL/ELT workflows using Apache Airflow for orchestration.
  • Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services.
  • Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift).
  • Data Quality & Governance - Implement automated validation, testing, and monitoring for data integrity.
  • Performance & Troubleshooting - Monitor workflows, enhance logging/alerting, and fine-tune performance.
  • Data Modelling - Handle schema evolution, partitioning strategies, and efficient data structures.
  • CI/CD for Data - Work with DevOps teams to integrate pipelines into robust CI/CD processes, managing version control for DAGs and configurations.
  • Security & Compliance - Apply encryption, access control (IAM), and GDPR-aligned data practices.

Technical Skills & Experience

  • Proficient in Python and SQL for data processing.
  • Solid experience with Apache Airflow - writing and configuring DAGs.
  • Strong AWS skills (S3, Redshift, etc.).
  • Big data experience with Apache Spark.
  • Knowledge of data modelling, schema design, and partitioning.
  • Understanding of batch and streaming data architectures (e.g., Kafka).
  • Experience with Docker and/or Kubernetes.
  • Familiarity with Microsoft SQL Server Stack (SQL Server, SSIS, C#, T-SQL), Elastic/OpenSearch.

Interested?

If you're ready to bring your data engineering expertise to a technically challenging and rewarding programme, apply now with your CV.

LNKD1_UKTJSeniority level

  • Seniority levelMid-Senior level

Employment type

  • Employment typeFull-time

Job function

  • Job functionInformation Technology
  • IndustriesData Infrastructure and Analytics

Referrals increase your chances of interviewing at Cyber Security Forum Initiative by 2x

Sign in to set job alerts for “Data Engineer” roles.

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 4 weeks ago

Software Engineer-Full stack (All Levels)

London, England, United Kingdom 1 month ago

London, England, United Kingdom 4 days ago

Graduate Software Developer - Fully Remote

Hertford Heath, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 months ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 6 months ago

Graduate Software Engineer 2025 - Platform

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 days ago

London, England, United Kingdom 6 days ago

London, England, United Kingdom 3 days ago

London, England, United Kingdom £55,000.00-£75,000.00 1 month ago

London, England, United Kingdom 1 day ago

London, England, United Kingdom 1 week ago

Graduate Software Engineer 2025 - RegTech

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 5 days ago

London, England, United Kingdom 2 years ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom $140,000.00-$180,000.00 1 week ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom $140,000.00-$180,000.00 1 month ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom $50,000.00-$200,000.00 8 months ago

London, England, United Kingdom 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.

Careers

Why Now Is the Perfect Time to Launch Your Career in Machine Learning: The UK's Intelligence Revolution

The United Kingdom stands at the epicentre of a machine learning revolution that's fundamentally transforming how we solve problems, deliver services, and unlock insights from data at unprecedented scale. From the AI-powered diagnostic systems revolutionising healthcare in Manchester to the algorithmic trading platforms driving London's financial markets, Britain's embrace of intelligent systems has created an extraordinary demand for skilled machine learning professionals that dramatically exceeds the current talent supply. If you've been seeking a career at the forefront of technological innovation or looking to position yourself in one of the most impactful sectors of the digital economy, machine learning represents an exceptional opportunity. The convergence of abundant data availability, computational power accessibility, advanced algorithmic development, and enterprise AI adoption has created perfect conditions for machine learning career success.

Jobs

Automate Your Machine Learning Jobs Search: Using ChatGPT, RSS & Alerts to Save Hours Each Week

ML jobs are everywhere—product companies, labs, consultancies, fintech, healthtech, robotics—often hidden in ATS portals or duplicated across boards. The fastest way to stay on top of them isn’t more scrolling; it’s automation. With keyword-rich alerts, RSS feeds, and a reusable ChatGPT workflow, you can bring relevant roles to you, triage them in minutes, and tailor strong applications without burning your evenings. This is a copy-paste playbook for www.machinelearningjobs.co.uk readers. It’s UK-centric, practical, and designed to save you hours each week. What You’ll Have Working In 30 Minutes A role & keyword map spanning LLM/NLP, Vision, Core ML, Recommenders, MLOps/Platform, Research/Applied Science, and Edge/Inference optimisation. Shareable Boolean searches you can paste into Google & job boards to cut noise. Always-on alerts & RSS feeds delivering fresh roles to your inbox/reader. A ChatGPT “ML Job Scout” prompt that deduplicates, scores fit, and outputs tailored actions. A lightweight pipeline tracker so deadlines and follow-ups never slip.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.