Data Engineer

The Open University UK
Milton Keynes
3 weeks ago
Create job alert

Job Location: Milton Keynes, Remote/Hybrid


Department: Data Technology


Closing Date: 5 March 2026


Weekly Working Hours: 37


Contract Type: Permanent


Fixed Term Contract: End Date: Not Applicable


Welsh Language: Not Applicable


Change your career, change lives

The Open University is the UK’s largest university, a world leader in flexible part-time education combining a mission to widen access to higher education with research excellence, transforming lives through education. Find out more about us and our mission by watching this short video (you will be taken to YouTube by clicking this link).


About the Role

Effective use of data is critical to the successful delivery of the Open University’s strategic goals. Reporting to the Data Technology Director within Digital Services, this key Data Engineer role is responsible for building, operating, and evolving the Data Technology capability for the Open University.


The successful candidate will be an experienced data engineering professional with strong expertise in modern data platforms, preferably Microsoft Azure. You will bring hands‑on experience with data engineering tools, programming languages, architectures, integration patterns, and operational best practices, and demonstrate the ability to implement these effectively at enterprise scale.


This role is responsible for the technical development of the Azure data platform and will act as the primary point of contact for data processing related to Tuition Services. As part of the Chief Data Office, the role will work closely with analytics and data teams to deliver a comprehensive and high‑quality data service to the University.


Key Responsibilities

  • Acting as an individual contributor across the wider technology team while serving as a specialist in data engineering.
  • Designing and delivering end‑to‑end data transformation pipelines, supporting both batch and streaming data ingestion.
  • Implementing resilient, self‑healing, and observable data ingestion and consumption infrastructure.
  • Taking technical ownership of workstreams, acting as the subject matter expert, and proactively managing risks and issues.
  • Defining, developing, and maintaining technical designs, documentation, and user artefacts, while driving continuous improvement within an agile delivery model.
  • Identifying and resolving technical problems and delivery roadblocks, working collaboratively with peers to drive issues to closure.
  • Performing performance tuning and code optimisation, and reviewing peers’ code to ensure adherence to best practices.
  • Mentoring and supporting the development of junior members of the data engineering team.
  • Working closely with the Data Engineering Lead and Analysts to ensure timely delivery of solutions that meet business and technical requirements.
  • Supporting technology innovation initiatives across the Open University through proofs of concept and exploratory work.

During the initial phase, the role will focus on:



  • Delivering highly critical data engineering solutions that enable the Open University to achieve its key strategic programmes.
  • Working closely with the Tuition Services team on current and future data processing, reporting, and analytics solutions.
  • Defining and delivering a roadmap for data platform uplift, aligned with Microsoft Azure’s technology roadmap, to meet future analytics needs in a cost‑effective and scalable manner.

About You

  • Communicating effectively with stakeholders at all levels, managing expectations, and facilitating discussions in high‑risk, complex, or time‑constrained environments.
  • Designing and delivering enterprise‑scale data integration solutions across the full data development lifecycle, with strong expertise in cloud‑based data engineering (preferably Microsoft Azure).
  • Leading and motivating teams to ensure the reliable and efficient delivery of enterprise data services.
  • Implementing both on‑premises and cloud‑based data engineering solutions, with hands‑on experience in relational databases, ETL tools, and programming languages such as SQL, Python, PySpark, and Java.
  • Defining and enforcing data engineering standards, architectural patterns, and industry best practices.
  • Advising on and shaping future technology roadmaps to deliver long‑term business value.
  • Investigating emerging data technologies and trends, conducting horizon scanning, and introducing innovative approaches and ways of working.
  • Azure certification as a Cloud Architect or Cloud Data Engineer.
  • Practical experience in cloud‑based development on the Microsoft Azure platform.
  • Strong hands‑on experience with Azure Data Factory, Data Lake, Synapse, SQL Database, and Microsoft Fabric.
  • Experience with Azure Databricks and Spark cluster management.
  • Experience building Azure Data Factory pipelines and configuring CI/CD pipelines using Git.

Support with your application

If you have any questions, or need support or adjustments relating to your application, the recruitment process, or the role, please contact us on or email quoting the advert reference number.


What's in it for you?

At The Open University, we offer a range of benefits to recognise and reward great work, alongside policies and flexible working that contribute towards a great work life balance. Get all the details of what benefits we offer by visiting our Staff Benefits page (clicking this link will open a new window).


We are open to discussions about flexible working. Whether it’s a job share, part time, compressed hours or another working arrangement. Please reach out to us to discuss what works best for you.


It is anticipated that a hybrid working pattern can be adopted for this role, where the successful candidate can work from home and the office. However, as this role is contractually aligned to our Milton Keynes office it is expected that some attendance in the office will be required when necessary and in response to business needs. We’d expect this to be approximately once per month.


Next steps in the Recruitment process

We anticipate that interviews for this role will be taking place online via Microsoft Teams during the week commencing 16 March 2026.


Early closing date notification

We may close this job advert earlier than the published closing date where a satisfactory number of applications are received. We would therefore encourage early applications.


How to apply

To apply for this role please submit the following documents:



  • CV
  • A personal statement of up to 1000 words. You should set out in your statement why you are interested in the role and provide examples of where your skills and experience meet the required competencies for this role as detailed in the job description.

You can view your progress and application communications when you are logged into our recruitment system. Please check your spam/junk folders if you do not receive associated email updates.


If you have any queries or questions about the recruitment process, or regarding your application,please contact: .


Looking for Associate Lecturer (AL) roles?

Please use our AL home page to find AL vacancies.


The Open University is committed to equality, diversity and inclusion which is reflected in our mission to be open to people, places, methods and ideas. We aim to foster a diverse and inclusive environment so that all in our OU community can reach their potential. We recognise that different people bring different perspectives, ideas, knowledge, and culture, and that this difference brings great strength.We strive to recruit, retain and develop the careers of a diverse pool of students and staff, and particularly encourage applications from all underrepresented groups. We also aspire to make The Open University a supportive workplace for all through our policies, services and staff networks.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.