Shape the Future of AIJoin one of the UK's fastest-growing companies and become a Professional Development Expert in Artificial Intelligence.

View Roles

Senior Data Engineer

Reed Talent Solutions
Bedford
6 days ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Winchester

Senior Data Engineer - Cloud

Senior Data Engineer

Join to apply for theSenior Data Engineerrole atReed Talent Solutions

Join to apply for theSenior Data Engineerrole atReed Talent Solutions

Reed Talent Solutions provided pay range

This range is provided by Reed Talent Solutions. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from Reed Talent Solutions

Executive IT Talent Partner - IT/Technology

c. £62,000 per annum

Bedford Based

Hybrid Working

Permanent

Join us at the Money and Pensions Service (MaPS) as a Senior Data Engineer where you will design and lead the implementation of data flows to connect operational systems, data for analytics and business intelligence (BI) systems predominantly in a Microsoft Azure environment.

The Senior Data Engineer reports to the Lead Data Engineer. The role is aligned to the Government Digital and Data Profession Capability Framework: Senior Data Engineer: https://ddat-capability-framework.service.gov.uk/role/data-engineer#senior-data-engineer

You’ll be part of a dynamic team dedicated to helping people across the UK improve their financial wellbeing. Specifically, the role will focus on supporting reporting for the Pensions Dashboard Programme and MoneyHelper Pensions Dashboard: https://www.pensionsdashboardsprogramme.org.uk/

Key Responsibilities:

Data Pipelines and ETL Processes

• ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions.

• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless data flow.

• Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes to maintain data integrity.

• Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer.

• Ensure the scalability and reliability of data solutions using Azure's suite of services.

Collaboration and Leadership

• Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs.

• Provide technical leadership and mentorship to junior data engineers, fostering a culture of continuous learning and improvement.

Data Governance and Quality

• Ensure data governance policies are adhered to and maintain high standards of data quality and security.

• Develop and enforce best practices for data management and integration.

• Ensure only thoroughly tested, high quality code, architecture and resulting Data Products are delivered to the MaPS business.

Data Landscape

• Understanding & interest of broad architectural principles underlying modern data architecture. E.g. Data Lakes, External tables, medallion architecture, loose coupling.

• Reporting & analysis tooling. An understanding of report tooling such as Power BI & the needs of analysts consuming engineered data into these tools.

You will need to demonstrate the following skills and experience.

  • Proven experience as a Data Engineer, with a focus on Azure services.
  • Strong expertise in designing and implementing ETL processes.
  • Experience in using SQL to query and manipulate data.
  • Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory.
  • Understanding of data extraction from vendor REST APIs.
  • Spark/Pyspark or Python skills a bonus or a willingness to develop these skills.
  • Experience with monitoring and failure recovery in data pipelines.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

About Us

The Money and Pensions Service (MaPS) is based in Bedford, in a recently renovated modern office. This is a wonderful opportunity for you to become an integral part of a dynamic organisation, working to help people across the UK.

At the heart of the Money and Pensions Service are our values – caring, connecting, and transforming, which are the foundation of our success. They permeate every area of our work and define all our business relationships and the way we work with each other. We’re not only looking for the best people to come and work for us, but we need people who align themselves with our values:

  • Caring -We care about our colleagues and the people whose lives we are here to transform.
  • Connecting -We will transform lives through our ability to make positive connections.
  • Transforming -We are committed to transforming lives and making a positive societal impact.

By fostering our values, we are immensely proud of the inclusive working environment that we have created. The diversity of our people is a strength that we embrace and wish to build upon, so we are committed to attracting people of all backgrounds. We work hard to ensure that we have a progressive approach to inclusion, equity, and belonging. We really do want our colleagues to “bring their whole selves to work.”

Our colleague and ally networks encompass LGBTQ+, neurodiversity, women’s health, men’s health, ethnicity, and diversity.

What We Offer

This role will offer the opportunity to develop your career in a Cloud only environment with a high level of technical freedom, working with other highly technical and skilled engineers as well as benefits below:

  • Pension scheme – contributions matched 2 to 1 (up to 10% of your salary)
  • Interest-free loan for season tickets for buses and trains
  • Cycle to work Scheme
  • Subsidised eye tests & flu jabs
  • Give as you earn scheme
  • Employee assistance programme (EAP)
  • Enhanced family and sick pay
  • Paid volunteering (2 days a year)
  • Recognition Scheme
  • Discounts portal to numerous retailers

Flexible Working

At MaPS, we take pride in our flexible approach to work. As standard, we work on a hybrid basis with a minimum of 2 days in the office per week. Hybrid working is a voluntary, non-contractual arrangement and our headquarters in Bedford will be your contractual place of work. The number of days that anyone will be able to work at home will be determined primarily by business needs, but personal and other relevant circumstances will also be considered. If you are successful, any opportunities for hybrid working, including whether a hybrid working arrangement is suitable for you, will be discussed with you prior to you taking up your post.

In MaPS, we take career development seriously. We actively encourage and support applications from our existing MaPS colleagues. However, we do follow the Civil Service Commissioner recruitment principles, which means that you will be required to participate in a full, open, and fair process.

Reserve List

If you are successful at interview, we operate a reserve list where your details will be held for up to 6 months. Should a vacancy come available in that time with the same essential criteria, reserve list candidates will be offered that position with no further assessment required.

Application Process

The law requires that selection for appointment to the Civil Service is on merit on the basis of fair and open competition as outlined in the Civil Service Commission’s Recruitment Principles. If you feel your application has not been treated in accordance with the Recruitment Principles, and you wish to make a complaint, in the first instance, you should contact the Money and Pensions Service via email: . If you are not satisfied with the response you receive from the Department, you can contact the Civil Service Commission: Visit the Civil Service Commission website.

Job Reference:MaPS00923

Close Date:13/08/2025

Seniority level

  • Seniority levelMid-Senior level

Employment type

  • Employment typeFull-time

Job function

  • Job functionInformation Technology and Finance
  • IndustriesTechnology, Information and Media, Financial Services, and Staffing and Recruiting

Referrals increase your chances of interviewing at Reed Talent Solutions by 2x

Get notified about new Data Engineer jobs inBedford, England, United Kingdom.

Bedford, England, United Kingdom 6 days ago

Ampthill, England, United Kingdom 2 weeks ago

Ice Cream Digital and Data – Data Scientist

Sharnbrook, England, United Kingdom 1 week ago

Bedford, England, United Kingdom 6 days ago

Ampthill, England, United Kingdom 2 weeks ago

Bedford, England, United Kingdom 5 days ago

Ampthill, England, United Kingdom 2 weeks ago

Ampthill, England, United Kingdom 2 weeks ago

Cranfield, England, United Kingdom 2 weeks ago

Bedford, England, United Kingdom 4 hours ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Automate Your Machine Learning Jobs Search: Using ChatGPT, RSS & Alerts to Save Hours Each Week

ML jobs are everywhere—product companies, labs, consultancies, fintech, healthtech, robotics—often hidden in ATS portals or duplicated across boards. The fastest way to stay on top of them isn’t more scrolling; it’s automation. With keyword-rich alerts, RSS feeds, and a reusable ChatGPT workflow, you can bring relevant roles to you, triage them in minutes, and tailor strong applications without burning your evenings. This is a copy-paste playbook for www.machinelearningjobs.co.uk readers. It’s UK-centric, practical, and designed to save you hours each week. What You’ll Have Working In 30 Minutes A role & keyword map spanning LLM/NLP, Vision, Core ML, Recommenders, MLOps/Platform, Research/Applied Science, and Edge/Inference optimisation. Shareable Boolean searches you can paste into Google & job boards to cut noise. Always-on alerts & RSS feeds delivering fresh roles to your inbox/reader. A ChatGPT “ML Job Scout” prompt that deduplicates, scores fit, and outputs tailored actions. A lightweight pipeline tracker so deadlines and follow-ups never slip.

10 Machine‑Learning Recruitment Agencies in the UK You Should Know (2025 Job‑Seeker Guide)

With deep‑learning projects now integral across healthcare, finance and tech, UK demand for machine‑learning talent is booming. Lightcast shows +50 % YoY growth in UK adverts referencing “machine learning,” “deep learning,” “computer vision” or “reinforcement learning” in Q1 2025. Monthly vacancies sit around 1,800–2,100, but certified ML specialists number fewer than 15,000. Specialist recruiters help candidates access hidden roles, competitive packages, and structured interview prep. How we screened: Only UK‑registered agencies with clear ML/AI or Data practices Agencies that posted ≥ 5 UK ML roles between March and June 2025

Machine Learning Jobs Skills Radar 2026: Emerging Tools, Frameworks & Platforms to Learn Now

Machine learning is no longer confined to academic research—it's embedded in how UK companies detect fraud, recommend content, automate processes & forecast risk. But with model complexity rising and LLMs transforming workflows, employers are demanding new skills from machine learning professionals. Welcome to the Machine Learning Jobs Skills Radar 2026—your annual guide to the top languages, frameworks, platforms & tools shaping machine learning roles in the UK. Whether you're an aspiring ML engineer or a mid-career data scientist, this radar shows what to learn now to stay job-ready in 2026.