Principal Data Engineer in TECHNOLOGY DATA SERVICES

Bank of England
Leeds
4 days ago
Create job alert

Leeds, United Kingdom; London, United Kingdom


Job Description

Principal Data Engineer, Technology Directorate


Permanent


Full Time


Flexible Working Options


This role is open to flexible working patterns, these may include:



  • Job share
  • Flexible start and end time to each day
  • Ability to adapt calendar as needed, this could be to fit in the school run, gym, or appointments
  • A 50% in-office attendance requirement can be spread across the month to accommodate diverse working patterns, such as the flexibility to purchase a weekly train ticket for certain weeks
  • Compressed hours (subject to approval and policy within the team)
  • Working from abroad policy (subject to approval and policy within the team)

A Day in the Role:


Your day starts with aligning across programmes and teams, ensuring the Bank’s data initiatives are moving in the right strategic direction. Apart from focusing on your individual tasks, you also concentrate on the bigger picture – identifying risks, guiding priorities, and shaping how teams work together.


Throughout the day, you act as a technical leader and strategic advisor, helping define how the organisation designs, governs, and uses data. You work with senior stakeholders across technology, governance, and business areas to ensure the platform remains trusted, scalable, efficient, and compliant.


A key part of your role is setting standards and enabling others: guiding engineering approaches, mentoring senior colleagues, and helping teams adopt consistent patterns that raise quality and accelerate delivery across the organisation.


You also contribute to cross‑Bank initiatives — from modernisation programmes to long‑term platform strategy — influencing decisions that shape how the Bank manages and uses data in the future.


By the end of the day, your impact is measured not in code delivered, but in clarity provided, decisions unblocked, teams strengthened, and strategic direction reinforced.


Opportunities in Leeds


We’re excited to be growing our presence in Leeds, a city we’ve been connected to for nearly 200 years! Our modern, accessible office in the City Centre offers a supportive, flexible working environment. The majority of roles, including this one, are now available in Leeds, giving you the chance to build a meaningful career outside of London while contributing to our mission from a dynamic and growing location. You’ll work collaboratively with London-based colleagues in a hybrid model, with regular opportunities to travel into the London office to meet and connect together in person.


Want to learn more? Discover what makes our Leeds office such a dynamic place to work by visiting our Leeds page for more details.


About Us


We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable! We continuously evolve our offerings, using modern cloud-based technologies, and foster strong partnerships to help our colleagues in the Bank navigate the complexities of a data-driven world and achieve their strategic objectives.


Job Description


The use of data within Central Banking is evolving. The combination of data being collected at scale and significant advances in data technology has created the need to expand our Data Engineering team in Data Services. We are building the Bank’s strategic cloud data platform to host products that solve real‑world problems while putting customers at the centre. The Principal Data Engineer will play a pivotal role in designing, implementing, and supporting data pipelines on the Bank’s data platform. You will lead innovative, data‑centric products and predictive analysis work while developing automated solutions that continuously improve data engineering across the Bank. Your technical leadership will establish a centre of excellence, ensure regulatory compliance, and deliver smart, customer‑focused designs.


Role Requirements



  • Design, develop, test, and deploy scalable, cost‑effective, and secure distributed architectures using Azure services such as Azure Data Factory and Azure Databricks.
  • Collaborate with cross‑functional teams to translate business and technical requirements into innovative, automated solutions.
  • Continuously innovate and evolve data ingestion and transformation framework design and implementation to meet modern data platform needs while providing comprehensive guidelines for customers.
  • Manage the technical relationship with one or more Azure Data product groups, identifying common solution patterns and developing reusable frameworks.
  • Lead the identification of dependencies and produce detailed design documents for data pipeline solutions.
  • Leverage subject‑matter expertise to drive project and release plans with key stakeholders including SMEs and Product Owners.
  • Participate in organisation‑wide projects and steering committees while devising strategies for containerisation, orchestration, and API management.
  • Design robust data replication architectures and implement methods to integrate AI and ML into platform and backend solutions in line with responsible AI principles.
  • Collaborate with the data governance team to enforce a comprehensive data catalogue, maintain detailed dataset descriptions, and ensure adherence to security and privacy regulations.
  • Work with Cloud teams and key stakeholders to optimise cloud costs using FinOps principles and enforce data platform‑centric FinOps policies.
  • Provide mentorship and coaching to data engineers on modern tools and technologies in Azure, data pipeline management, coding practices, design principles, and implementation patterns.
  • Extensive experience in data engineering on an Azure data platform, with a strong background in modernisation and large‑scale migration projects. Proven ability to coach and mentor others effectively in a senior capacity.
  • Demonstrable experience designing and managing metadata‑driven frameworks using Azure Data Factory and Azure Databricks.
  • Competence in and hands‑on experience managing Databricks environments and developing lakehouse architectures with a focus on automation, performance tuning, cost optimisation, and system reliability.
  • Proven proficiency in programming languages such as Python, T‑SQL, and PySpark, with practical knowledge of test‑driven development.
  • Demonstrated capability in building secure, scalable data solutions on Azure with an in‑depth understanding of data security and regulatory compliance, using tools like Microsoft Purview and Unity Catalog.
  • Proven ability to coach and mentor others effectively in a senior capacity, showcasing leadership skills.
  • Excellent communication and collaboration skills with a track record of building and managing teams effectively.
  • In‑depth knowledge of data engineering practices and tools, including strategic decision‑making within cloud environments.
  • Strong problem‑solving and adaptability to manage complex and dynamic projects.
  • Excellent leadership and communication skills with a proven track record in mentoring teams and driving data modernisation initiatives.
  • Experience working with advanced containerisation and orchestration tools such as Azure Container Instances or Kubernetes.
  • Prior experience designing and implementing AI/ML driven solutions within data platforms.
  • Relevant certifications such as Azure Data Engineer Associate, Azure Solutions Architect, or equivalent industry credentials.
  • Advanced academic qualifications or industry accolades that complement practical experience in data engineering and cloud technologies.
  • Experience in DevOps practices using Azure DevOps and GitHub Actions, designing automated CI/CD pipelines and implementing Infrastructure as Code(terraform, ARM templates, or Azure Bicep)

Our Approach to Inclusion


The Bank values diversity, equity and inclusion. We play a key role in maintaining monetary and financial stability, and to do that effectively, we believe we need a workforce that reflects the society we serve.


At the Bank of England, we want all colleagues to feel valued and respected, so we're working hard to build an inclusive culture which supports people from all backgrounds and communities to be at their best at work. We celebrate all forms of diversity, including (but not limited to) age, disability, ethnicity, gender, gender identity, race, religion, sexual orientation and socioeconomic status. We believe that it’s by drawing on different perspectives and experiences that we’ll continue to make the best decisions for the public.


We welcome applications from individuals who work flexibly, including job shares and part time working patterns. We've also partnered with external organisations to support us in making adjustments for candidates and employees in the recruitment process where they're needed.


For most roles where work can be carried out at home, we aim for colleagues to spend half of their time in the office, with a minimum of 40% per month. Subject to that minimum requirement, individuals and managers should work together to find what works best for them, their team and stakeholders.


Finally, we're proud to be a member of the Disability Confident Scheme . If you wish to apply under this scheme, you should check the box in the ‘Candidate Personal Information’ under the ‘Disability Confident Scheme’ section of the application.


Salary and Benefits Information


We encourage flexible working, part time working and job share arrangements. Part time salary and benefits will be on a pro‑rated basis as appropriate.


In addition, we also offer a comprehensive benefits package as detailed below:



  • Currently a non‑contributory, career average pension giving you a guaranteed retirement benefit of 1/80th of your annual salary for every year worked. There is the option to increase your pension (to 1/65th) or decrease (to 1/105th) in exchange for salary through our flexible benefits programme each year. The Bank has the discretion to vary standard accrual rates and dial up and dial down rates at any time and to withdraw dial up and dial down options at any time.
  • A discretionary performance award based on a current award pool.
  • An 8% benefits allowance with the option to take as salary or purchase a wide range of flexible benefits.
  • 26 days’ annual leave with option to buy up to 12 additional days through flexible benefits.
  • Private medical insurance and income protection.

National Security Vetting Process


Employment in this role will be subject to the National Security Vetting clearance process (and typically can take between 6 to 12 weeks post offer) and the passing of additional Bank security checks in accordance with the Bank policy. Further information regarding the vetting and security clearance requirements for the role will be provided to the successful applicant, and information about how the Bank processes personal data for these purposes, is set out in the Bank's Privacy Notice .


The Bank of England welcomes applications from all candidates, but as a UK Visas and Immigration (UKVI) approved sponsor, we have a responsibility to comply with the Immigration Rules and guidance. As such, our ability to employ individuals who require sponsorship for immigration purposes is limited. The Bank cannot guarantee that you and / or the role you are applying for will be eligible for sponsorship and that any application made to UKVI will be successful. Eligibility will therefore be considered on a case by case basis.


The Application Process


Important: Please ensure that you complete the ‘work history’ section and answer ALL the application questions fully. All candidate applications are anonymised to ensure that our hiring managers will not be able to see your personal information, including your CV, when reviewing your application details at the screening stage. It’s therefore really important that you fill out the work history and application form questions, as your answers will form a critical part of that initial selection process.


The assessment process will comprise of two interview stages.


This role closes on 24 March 2026


Please apply online, ensuring that you complete your work history and answer ALL the application questions fully and in detail as your application will not be considered if all mandatory questions are not fully completed.


About Us

We are the UK's central bank - and we are a bank like no other; known by our peers for our world‑leading thinking on policy and strategy.


Our mission is to promote the good of the people of the UK by maintaining monetary and financial stability. We seek to keep prices stable and people's money safe. We know our work matters to people, to families, up and down the UK.


It takes a great team to run the Bank of England. We rely on each other to play our part. We benefit from a collaborative culture and long‑established flexible ways of working, supporting our colleagues balance their work and personal lives. We strive to be a place where people feel they belong and have equal access to opportunities, because different perspectives helps us make the best decisions for the public.


There’s much to gain from working with us - from career defining work at the heart of the UK economy, being part of a fantastic team, and a rewarding compensation package.


Join us and find a bank like no other. Together, we can make a difference.


The Bank of England will use and protect the information you provide when you apply for a role with us, in line with our obligations under data protection law. This is so we can assess your suitability for the role and administer your application. If you’re successful we’ll use it to offer you a position and onboard you to join the Bank.


If you would like more details about how your information will be used and your information rights, please visit our recruitment privacy notice.


Job Info

  • Job Identification 1871
  • Job Category Technology
  • Posting Date 03/03/2026, 01:33 PM
  • Apply Before 03/24/2026, 11:59 PM
  • Job Schedule Full time


#J-18808-Ljbffr

Related Jobs

View all jobs

Principal Data Engineer

Principal Data Engineer

Senior Data Engineering Lead | Remote Delivery & Strategy

Principal Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.