Senior Data Engineer

UK Home Office
Liverpool
1 month ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Lead Technical Recruiter - Architecture, Delivery and Product

Senior Data Engineers lead the design and implementation of complex data flows, connecting operational systems to analytics platforms. In this role, you’ll work with the EUC&C community to identify data sources, engage with analysts and stakeholders, and build robust pipelines that align with business needs through collaboration with Product Owners.


The Senior Data Engineer collects, organise and study data to provide business insight. Collaborating with fellow members of the Data Engineering community to set the direction of the service technology and data architecture. The post holder will also mentor more junior members of the team – promoting challenge, collaborating and encouraging an agile approach to working.


The End User Compute and Collaboration (EUC&C) team develops and delivers a range of Microsoft 365 solutions, including Teams, SharePoint, OneDrive, Power Platform, and Office applications. These tools support collaboration and productivity across the organisation.


This role is not suitable for part‑time working due to business requirements and the nature of the role – this is only available for full‑time.


Responsibilities

  • Analyse problems and experiment with possible solutions to find the underlying causes of issues or discrepancies, identify problems and assist in the development of innovative solutions.
  • Analyse and report on test activities and results, providing support to data engineers and stakeholders in addressing data analysis challenges.
  • Design and implement a data streaming service, including the development of new data models and ETL processes.
  • Apply concepts and principles of conceptual, logical, and physical data modelling and produce relevant and varied data models across multiple subject areas, providing guidance on how to use them.
  • Ensure the successful delivery of completed data loads for customers, Data Analysts and Data Scientists, troubleshooting where required.
  • Design, build and test data products and solutions that are complex or large scale, through full development, test and deployment life cycles.
  • Use industry‑standard ETL tools, data cleaning, network databases and scheduling and orchestration tools such as MSSQL, OneLake, MS Fabric workflows.
  • Leverage modern open‑source programming languages, such as Python and PowerShell, to develop and deliver high‑quality data development and engineering solutions.
  • Utilise Cloud Data technologies and solutions while shaping future cloud data strategies, with experience in Azure and M365 platforms.
  • Effectively manage and communicate with non‑technical and senior stakeholders about performance and analysis.
  • Understand API Design Principles: Familiarity with REST, GraphQL and GraphAPI, including best practices for endpoint creation, data serialisation and verification.

What you will bring

  • Deliver projects in data analysis, solution design and end‑user reporting.
  • Program and automate in Power Bi, Azure Automation, Azure Data Factory, Azure.
  • Use dev‑ops tools and orchestration workflows.
  • Leverage modern open‑source programming languages.
  • Utilise Cloud Data technologies and platforms.
  • Communicate with non‑technical and senior stakeholders.
  • Understand API Design Principles.

Seniority level

Mid‑Senior level


Employment type

Full‑time


Job function

Information Technology, Strategy/Planning, and Engineering


Industries

Government Administration


Referrals increase your chances of interviewing at UK Home Office by 2x



#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.