National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineer

Kieran Knight Consulting
Liverpool
2 weeks ago
Create job alert

Azure/Databricks Data Engineer (D365 F&O Deployment)

£550 - £580 PER DAY

6 month contract

OUTSIDE IR35

REMOTE, but have to be UK based

Our client, a leader in their field, requires a talented Data Engineer, to join their Group technology team, responsible for the global intelligent data platform. You will be joining the business at a key moment in their evolution and will make a key and lasting impact on our technology organisation and landscape. Reporting to the Group Director of Data and Architecture with responsibility for the data workloads delivered against their Azure/Databricks platform.

You will be working within a major transformation programme migrating data to D365 F&O. You will be expected to have a proactive, hands-on approach.

You will be a key contributor to designing, developing, and managing data ingestion processes and transformation pipelines within Azure and Databricks environments.

The role involves utilizing Databrick's medallion architecture to create well-defined and governed data consumption models, adopting a data-as-a-product mindset and implementing key platform governance steps such as master data management and augmentation, governance, observability and exception/quality reporting

The ideal candidate will have experience in cloud data engineering, an understanding of Databricks, and a strong proficiency in Azure data services.

YOUR SKILLS:

  • Minimum of 5 years of experience in data engineering with a focus on cloud technologies.
  • Proven experience with Azure services (eg, Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse, Azure Blob Storage).
  • Extensive experience with Databricks, including the development and management of data pipelines.
  • Strong proficiency in SQL, reasonable Python skills.
  • Experience with data governance, data quality, and data security best practices.
  • Familiarity with data-as-a-product concepts and methodologies.
  • Excellent problem-solving skills and ability to work in a fast-paced, dynamic environment.
  • Strong communication and collaboration skills.
  • Previous experience in a D365 Data Migration role, with experience in Finance & Operations.
  • Extensive wider knowledge of the Microsoft D365 application stack.
  • Proficiency in F&O standards documentation and best practices.
  • Good understanding and solution design experience of technologies. This includes, but is not restricted to, solutions such as:
  • Microsoft Dynamics Finance and Operations
  • Microsoft Power Platform
  • Microsoft Collaboration Platforms (Office365, SharePoint, Azure DevOps)

WHAT YOU WILL BE DOING:

  • Design, implement, and maintain scalable and efficient data pipelines for ingestion, processing, and storage of global enterprise datasets using Azure and Databricks.
  • Take end-to-end ownership of application ingestion workloads, ensuring all platform steps/runbooks are adopted.
  • Utilize Databrick's medallion architecture (bronze, silver, gold layers) to ensure clean, reliable, and organized data flows.
  • Ensure strict version control and reproducibility of data transformations using the DBT toolset.
  • Develop and maintain ETL processes to transform raw data into structured data sets for analysis and consumption.
  • Work within our data governance framework to implement our runbook to provide best practices to ensure data quality, accessibility, security, and compliance.
  • Collaborate with identified data stewards to define productised data consumption. models/products and ensure workload datasets map to the target models.
  • Ensure master data structures and reference data are correctly augmented to each workload.
  • Optimize and troubleshoot data pipelines to ensure high performance and reliability.
  • Use best practice implementations for observability, alerting and monitoring to evolve an effective data operation function.
  • Align workloads to our master data management function to ensure data can be matched across applications/workloads.

If your profile matches the above, please send your CV for full details:

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Present Machine Learning Solutions to Non-Technical Audiences: A Public Speaking Guide for Job Seekers

Machine learning is driving change across nearly every industry—from retail and finance to health and logistics. But while the technology continues to evolve rapidly, the ability to communicate it clearly has become just as important as building the models themselves. Whether you're applying for a junior ML engineer role, a research position, or a client-facing AI consultant job, UK employers increasingly expect candidates to explain complex machine learning solutions to non-technical audiences. In this guide, you’ll learn how to confidently present your work, structure your message, use simple visuals, and explain the real-world value of machine learning in a way that makes sense to people without a background in data science.

Machine Learning Jobs UK 2025: 50 Companies Hiring Now

Bookmark this page—we refresh the Hotlist every quarter so you always know who’s really scaling their ML teams. The UK’s National AI Strategy, a £2 billion GenAI accelerator fund and a record flow of private capital have kicked ML hiring into overdrive for 2025. Whether you build production‑grade LLM services or optimise on‑device models for edge hardware, employers need your skills now. Below you’ll find 50 organisations that advertised UK‑based machine‑learning vacancies or announced head‑count growth during the past eight weeks. They’re grouped into five quick‑scan categories so you can jump straight to the type of employer—and mission—that excites you. For each company we list: Main UK hub Example live or recent vacancy Why it’s worth a look (stack, impact, culture) Search any employer on MachineLearningJobs.co.uk to see real‑time adverts, or set a free alert so fresh openings drop straight in your inbox.

Return-to-Work Pathways: Relaunch Your Machine Learning Career with Returnships, Flexible & Hybrid Roles

Returning to work after an extended break can feel like starting from scratch—especially in a specialist field like machine learning. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s machine learning sector now offers a variety of return-to-work pathways. From structured returnships to flexible and hybrid roles, these programmes recognise the transferable skills and resilience you’ve developed, pairing you with mentorship, upskilling and supportive networks to ease your transition back. In this guide, you’ll discover how to: Understand the current demand for machine learning talent in the UK Leverage your organisational, communication and analytical skills in ML contexts Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to machine learning Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your career relaunch with caring responsibilities Master applications, interviews and networking specific to ML Learn from inspiring returner success stories Get answers to common questions in our FAQ section Whether you aim to return as an ML engineer, research scientist, MLOps specialist or data scientist with an ML focus, this article will map out the steps and resources you need to reignite your machine learning career.