Senior Data Engineer

The Pensions Regulator
Brighton
4 days ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Energy

Senior Data Engineer, SQL, RDBMS, AWS, Python, Mainly Remote

Directorate

DDaT


Starting salary

Salary from £63,213 per annum


Contract type

Permanent


Location

Brighton/hybrid (6 days per month in the office)


Closing date

5 January 2026


The role and responsibilities

  • Work with business users and the product owner to translate user stories into technical delivery, then having full ownership of the workstreams within their squad.
  • Be a hands‑on data engineer across the suite of Azure services compiling the TPR’s Data Platform.
  • Build scalable and cost‑efficient solutions using Azure data technologies, adhering to best practices and agile processes to the highest possible standards.
  • Stay up to date with evolving technologies, ensure TPR’s data platform and the data engineering team remain current through coaching and technical training.
  • Ensure that the Data Platform adheres to TPR’s data governance and compliance policies.
  • Support operational processes and end users, implementing monitoring and alerting practices to ensure service reliability.
  • Supervise and mentor the development of more junior data engineers and support staff.
  • Provide guidance as needed to TPR data analysts on interfacing with the Data Platform technologies and work with colleagues to support building data capability across the user community.
  • Support the Principal Data Engineer in leading the sub‑team, designing solutions and deputise for them where required.

The role criteria

  • Understanding of cloud data platforms and data storage technologies (ideally Azure).
  • Demonstrable hands‑on Data Engineering development experience.
  • Excellent SQL skills at both a functional and non‑functional level.
  • Understanding of data integration and workflow applications (ideally Azure Data Factory).
  • Understanding of Agile working methodologies.
  • Use of a branch‑based source control (e.g., Git).
  • Experience of coaching others to develop their skills and career.
  • Python, Spark, C#, or other relevant programming skills.
  • Proactive and flexible.
  • Ability to prioritise and use initiative.
  • Problem solving and analytical skills.
  • Communication skills at all levels.
  • Attention to detail and accuracy.

The team

Our Digital, Data and Technology department is driving transformation at TPR to deliver positive outcomes for savers across the UK. Working within the Data Platform team, a successful candidate will be instrumental in building key solutions for TPR. They will also have a role in building the team and mentoring more junior members.


Reward and benefits

We offer 25 days annual leave plus bank holidays, a hybrid working model, 35 hour working week (full‑time), flexible working patterns, and flexitime. We also provide competitive parental leave, as well as a Civil Service Pension with an average employer contribution of 27%. Our dedicated benefits portal (Edenred) offers retail, gym, tech and restaurant discounts, and a cycle to work scheme.


Our culture

TPR strives to be a high‑performing organisation, and we prioritise our people's growth and well‑being. We offer various learning, secondment and development opportunities, support flexible working, and foster a diverse and inclusive environment.


Equality, diversity and inclusion is very important to us and we strive to make sure everyone has an equal opportunity to succeed. Our modern Brighton offices are in Telecom House overlooking Preston Park, they are over two floors of a shared building facility and when designed in 2023 we followed the government’s workplace design guide to ensure accessibility by design was achieved for our section.


We're proud to have a range of networks and opportunities to bring people together with supportive and safe spaces to connect with one another.


About The Pensions Regulator

With a career at TPR, you’ll be joining an organisation with real purpose and who are proud of their diverse range of skills and experience that positively impact on millions of people. Everyone at TPR plays an important role in helping to keep more than £2trn of savings safe.


Our Corporate Strategy outlines a bold and challenging vision of how pensions regulation should continue to evolve to keep pace with a change in the scale and nature of the pensions landscape. We believe diversity and inclusion are vital to good decision‑making for positive saver outcomes. We’re committed to creating a supportive, inclusive, and dynamic work environment where everyone can thrive; understanding the link between the work we do and its positive impact on society.


Applications

To avoid disappointment, we would invite you to submit your application as soon as possible, as we reserve the right to close the vacancy early if a high volume of applications are received. This is to ensure that we can continue to provide a positive candidate experience, with each application being reviewed and considered. Unfortunately, once a vacancy has closed, we are unable to consider further applications.


Current TPR employees who want to apply for this vacancy should first contact their line manager to discuss their application.


We welcome applications on a part time and job share basis.


Selection and interview

If you are shortlisted for interview, we’ll be in contact with you shortly after the closing date. We aim to respond to every application however due to the large volume of applications this is not always possible. If you have not heard from us within 21 days of submitting your application, please assume you have been unsuccessful on this occasion.


As a Disability Confident Employer, we’re committed to the recruitment, employment, retention, and development of people with disabilities, and to improving their employment opportunities. Candidates who declare that they have a disability and who meet the criteria outlined in the ‘what you will bring’ section will be offered an interview.


Diversity and inclusion

TPR is committed to promoting diversity, inclusion and equality in the workplace, creating an environment where everyone is encouraged to be themselves, enabling our people to feel supported, represented and do their best work.


We encourage applicants from all backgrounds and with different identities and experiences to apply for roles with TPR.


Further information

Please visit our website to find out what it is like to work at TPR, our culture, interview process and our commitment to our employees.


If you have any queries about this role, or if you have a disability and wish to request a reasonable adjustment at any stage of the recruitment process, please email .


Seniority level

Not Applicable


Employment type

Full‑time


Job function

Other


Industries

IT System Data Services


Referrals

Referrals increase your chances of interviewing at The Pensions Regulator by 2x.


Job Alerts

Get notified about new Data Engineer jobs in Brighton, England, United Kingdom.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Are you considering a career change into machine learning in your 30s, 40s or 50s? You’re not alone. In the UK, organisations across industries such as finance, healthcare, retail, government & technology are investing in machine learning to improve decisions, automate processes & unlock new insights. But with all the hype, it can be hard to tell which roles are real job opportunities and which are just buzzwords. This article gives you a practical, UK-focused reality check: which machine learning roles truly exist, what skills employers really hire for, how long retraining realistically takes, how to position your experience and whether age matters in your favour or not. Whether you come from analytics, engineering, operations, research, compliance or business strategy, there is a credible route into machine learning if you approach it strategically.

How to Write a Machine Learning Job Ad That Attracts the Right People

Machine learning now sits at the heart of many UK organisations, powering everything from recommendation engines and fraud detection to forecasting, automation and decision support. As adoption grows, so does demand for skilled machine learning professionals. Yet many employers struggle to attract the right candidates. Machine learning job adverts often generate high volumes of applications, but few applicants have the blend of modelling skill, engineering awareness and real-world experience the role actually requires. Meanwhile, strong machine learning engineers and scientists quietly avoid adverts that feel vague, inflated or confused. In most cases, the issue is not the talent market — it is the job advert itself. Machine learning professionals are analytical, technically rigorous and highly selective. A poorly written job ad signals unclear expectations and low ML maturity. A well-written one signals credibility, focus and a serious approach to applied machine learning. This guide explains how to write a machine learning job ad that attracts the right people, improves applicant quality and strengthens your employer brand.

Maths for Machine Learning Jobs: The Only Topics You Actually Need (& How to Learn Them)

Machine learning job adverts in the UK love vague phrases like “strong maths” or “solid fundamentals”. That can make the whole field feel gatekept especially if you are a career changer or a student who has not touched maths since A level. Here is the practical truth. For most roles on MachineLearningJobs.co.uk such as Machine Learning Engineer, Applied Scientist, Data Scientist, NLP Engineer, Computer Vision Engineer or MLOps Engineer with modelling responsibilities the maths you actually use is concentrated in four areas: Linear algebra essentials (vectors, matrices, projections, PCA intuition) Probability & statistics (uncertainty, metrics, sampling, base rates) Calculus essentials (derivatives, chain rule, gradients, backprop intuition) Basic optimisation (loss functions, gradient descent, regularisation, tuning) If you can do those four things well you can build models, debug training, evaluate properly, explain trade-offs & sound credible in interviews. This guide gives you a clear scope plus a six-week learning plan, portfolio projects & resources so you can learn with momentum rather than drowning in theory.