National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer - Azure / DataBricks

Shareforce
London
1 month ago
Create job alert

This is an exciting contract opportunity for anSC ClearedAzure Data Engineerwith a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the Azure ecosystem.

Responsibilities:

  • Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
  • Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
  • Drive best practices for data engineering.
  • Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
  • Mentor junior engineers and support their personal development.
  • Take ownership for the delivery of core solution components.
  • Support with planning, requirements refinements, and work estimation.


Skills & Experiences:

  • Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
  • Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
  • Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
  • Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real-time data processing.
  • Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
  • Good experience with CI/CD practices and tools for data platforms using Azure DevOps.
  • Good knowledge on how to leverage AI to increase deployment productivity and quality.
  • Excellent communication skills.
  • Desirable: certification inDatabricks Data Engineerand/orAzure Data Engineerare a plus.


Additional Information:

  • Rate offered: £500-550 per day
  • Location: Hybrid with travel to client site 1 day/ week in London
  • Start date: Mid/ end of July
  • Duration: 3 months initial sign up with significant opportunity for extension (current roadmap demonstrates 9 months scope of work)
  • Required: Active SC Clearance


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Jobs Skills Radar 2026: Emerging Tools, Frameworks & Platforms to Learn Now

Machine learning is no longer confined to academic research—it's embedded in how UK companies detect fraud, recommend content, automate processes & forecast risk. But with model complexity rising and LLMs transforming workflows, employers are demanding new skills from machine learning professionals. Welcome to the Machine Learning Jobs Skills Radar 2026—your annual guide to the top languages, frameworks, platforms & tools shaping machine learning roles in the UK. Whether you're an aspiring ML engineer or a mid-career data scientist, this radar shows what to learn now to stay job-ready in 2026.

How to Find Hidden Machine Learning Jobs in the UK Using Professional Bodies like BCS, Turing Society & More

Machine learning (ML) continues to transform sectors across the UK—from fintech and retail to healthtech and autonomous systems. But while the demand for ML engineers, researchers, and applied scientists is growing, many of the best opportunities are never posted on traditional job boards. So, where do you find them? The answer lies in professional bodies, academic-industry networks, and tight-knit ML communities. In this guide, we’ll show you how to uncover hidden machine learning jobs in the UK by engaging with groups like the BCS (The Chartered Institute for IT), Turing Society, Alan Turing Institute, and others. We’ll explore how to use member directories, CPD events, SIGs (Special Interest Groups), and community projects to build connections, gain early access to job leads, and raise your professional profile in the ML ecosystem.

How to Get a Better Machine Learning Job After a Lay-Off or Redundancy

Redundancy in machine learning can feel especially frustrating when your role was technically advanced, strategically important, or AI-facing. But the UK still has strong demand for machine learning professionals across fintech, healthtech, retail, cybersecurity, autonomous systems, and generative AI. Whether you're a research-oriented ML engineer, production-focused MLOps developer, or applied scientist, this guide is designed to help you bounce back from redundancy and find a better opportunity that suits your goals.