Data Engineer

The Open University
Milton Keynes
1 week ago
Create job alert
Overview

Are you a data engineering expert ready to shape the future of data at one of the UK’s most respected learning institutions?

Join The Open University as a Data Engineer and play a key role in developing modern data capabilities that enable better insight, analytics, and decision‑making across the organisation.

About the Role

Effective use of data is critical to the successful delivery of the Open University’s strategic goals. Reporting to the Data Technology Director within Digital Services, this key Data Engineer role is responsible for building, operating, and evolving the Data Technology capability for the Open University.

The successful candidate will be an experienced data engineering professional with strong expertise in modern data platforms, preferably Microsoft Azure. You will bring hands-on experience with data engineering tools, programming languages, architectures, integration patterns, and operational best practices, and demonstrate the ability to implement these effectively at enterprise scale.

This role is responsible for the technical development of the Azure data platform and will act as the primary point of contact for data processing related to Tuition Services. As part of the Chief Data Office, the role will work closely with analytics and data teams to deliver a comprehensive and high-quality data service to the University.

Key Responsibilities
  • Acting as an individual contributor across the wider technology team while serving as a specialist in data engineering.
  • Designing and delivering end-to-end data transformation pipelines, supporting both batch and streaming data ingestion.
  • Implementing resilient, self-healing, and observable data ingestion and consumption infrastructure.
  • Taking technical ownership of workstreams, acting as the subject matter expert, and proactively managing risks and issues.
  • Defining, developing, and maintaining technical designs, documentation, and user artefacts, while driving continuous improvement within an agile delivery model.
  • Identifying and resolving technical problems and delivery roadblocks, working collaboratively with peers to drive issues to closure.
  • Performing performance tuning and code optimisation, and reviewing peers’ code to ensure adherence to best practices.
  • Mentoring and supporting the development of junior members of the data engineering team.
  • Working closely with the Data Engineering Lead and Analysts to ensure timely delivery of solutions that meet business and technical requirements.
  • Supporting technology innovation initiatives across the Open University through proofs of concept and exploratory work.

During the initial phase, the role will focus on:

  • Delivering highly critical data engineering solutions that enable the Open University to achieve its key strategic programmes.
  • Working closely with the Tuition Services team on current and future data processing, reporting, and analytics solutions.
  • Defining and delivering a roadmap for data platform uplift, aligned with Microsoft Azure’s technology roadmap, to meet future analytics needs in a cost-effective and scalable manner.
About You
  • Communicating effectively with stakeholders at all levels, managing expectations, and facilitating discussions in high-risk, complex, or time-constrained environments.
  • Designing and delivering enterprise-scale data integration solutions across the full data development lifecycle, with strong expertise in cloud-based data engineering (preferably Microsoft Azure).
  • Leading and motivating teams to ensure the reliable and efficient delivery of enterprise data services.
  • Implementing both on-premises and cloud-based data engineering solutions, with hands-on experience in relational databases, ETL tools, and programming languages such as SQL, Python, PySpark, and Java.
  • Defining and enforcing data engineering standards, architectural patterns, and industry best practices.
  • Advising on and shaping future technology roadmaps to deliver long-term business value.
  • Investigating emerging data technologies and trends, conducting horizon scanning, and introducing innovative approaches and ways of working.
  • Azure certification as a Cloud Architect or Cloud Data Engineer.
  • Practical experience in cloud-based development on the Microsoft Azure platform.
  • Strong hands-on experience with Azure Data Factory, Data Lake, Synapse, SQL Database, and Microsoft Fabric.
  • Experience with Azure Databricks and Spark cluster management.
  • Experience building Azure Data Factory pipelines and configuring CI/CD pipelines using Git.
Support with your application

If you have any questions, or need support or adjustments relating to your application, the recruitment process, or the role, please contact us on or email quoting the advert reference number.

Why Join The Open University?

At The Open University, we’re pioneers in accessible, high‑quality education. This is your chance to help build future‑proof data capabilities that directly support students, staff, and the University’s long-term strategy.

Our benefits include:

  • 33 days annual leave, on top of bank holidays and a three-day Christmas closure period.
  • Access to a leading pension scheme for UK higher education with generous employer contributions.
  • Staff Fee Waivers for OU study, meaning you could earn a degree for free.
  • Hybrid working, with limited requirement to attend the office in-person, with agile working and family friendly policies.
  • Discounts, wellbeing support, and development opportunities.

Ready to help shape the future of data at the OU?

Apply now and be part of a team delivering transformative data solutions that power world‑class digital learning.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.