Senior Data Engineer

Sky
London
1 day ago
Create job alert

We believe in better. And we make it happen.
Better content. Better products. And better careers.
Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise and innovate. We turn big ideas into the products, content and services millions of people love.
And we do it all right here at Sky.

Within the Communications & Infrastructure group, RTA ( Real-Time Analytics ) is a platform that offers every team and every individual in Sky Technology a managed service of Sky's Telco telemetry data assets and enables data anal ytics at scale.

We are looking for a promising and seasoned Sr. Data Engineer who will act as a technical leader within the data engineering team, shaping the future of our data platform and enabling data-driven decision-making across the organisation.

This role goes beyond coding- it's about influencing strategy, fostering collaboration, and driving excellence in data lifecycle management.

What you'll do Lead technical decisions and shape the data platform's long-term vision for efficiency, scalability, and compliance.

Define and deliver the data platform roadmap, collaborating with stakeholders to align with business objectives .

Oversee and contribute to the end-to-end delivery of data processing capabilities - including design, development, and support - with a distributed team.

Drive continuous improvement in ways of working and foster innovation by exploring new technologies and methodologies.

Implement robust data lifecycle management and automation to ensure data quality, security, accessibility, and compliance.

What you'll bring Graduate degree (BSc) in Computer Science, Electrical Engineering, or related field, coupled with extensive experience in data engineering.

Cloud & Infrastructure-as-Code: Deep expertise in architecting on major cloud platforms (GCP/AWS) using Terraform for infrastructure automation and Git for robust version control and CI/CD workflows.

Big Data Processing & Engineering: Advanced proficiency in Python and SQL to build scalable batch and streaming ETL/ELT pipelines using distributed frameworks like Spark or Beam.

Data Architecture & Storage: Extensive experience managing diverse data ecosystems, including Relational/NoSQL databases, high-performance Data Warehouses, and complex storage for structured and unstructured data

Data Governance & Security: Hands-on experience implementing data quality frameworks, security protocols, and full data lifecycle management.

Proven ability to lead and motivate teams in dynamic environments, ideally in Telecom or similar industries where software is always-on and customer experience is critical.

Collaborative Problem Solving: A "lead by influence" mindset that values diverse perspectives and proactively removes roadblocks to ensure team success.

Adaptability in High-Stakes Environments: Proven resilience in dynamic, "always-on" industries (like Telecom), where system uptime and customer experience are mission-critical.

Technology Stack Apache Airflow / Kafka

GCP ( BigQuery , GCS, Composer, IAM)

Python

Terraform

Linux / Bash

Team overview

Looking to be part of non-stop innovation? Join our Group Communications and Infrastructure team and you'll work alongside experts in broadband, telephony, mobile, cloud and infrastructure. We're the team that designs, builds, supports and maintains the telecoms networks across the whole Sky Group. Together, we help Sky broadband, mobile and TV enter new markets by creating a single and secure infrastructure for the amazing content and services that keep our customers coming back for more.

The rewards

There's one thing people can't stop talking about when it comes to #LifeAtSky: the perks. Here's a taster: Sky Q, for the TV you love all in one place

The magic of Sky Glass at an exclusive rate

A generous pension package

Private healthcare

Discounted mobile and broadband

A wide range of Sky VIP rewards and experiences

Inclusion & how you'll work

We are a Disability Confident Employer, and welcome and encourage applications from all candidates. We will look to ensure a fair and consistent experience for all, and will make reasonable adjustments to support you where" appropriate . Please flag any adjustments you need to your recruiter as early as you can.

We've "embraced hybrid working and split our time between unique office spaces and the convenience of working from home. You'll find out more about what hybrid working looks like for your role later in the recruitment process.

Your office space

Brick Lane

Our Brick Lane office is in the heart of the East End of London. It's part of a vibrant and varied community; close to street food, cafes, and shops.

The closest tube station is Aldgate East and Liverpool Street is about a 10-minute walk.

We'd love to hear from you

Inventive, forward-thinking minds come together to work in Tech, Product and Data at Sky. It's a place where you can explore what if, how far, and what next.

But better doesn't stop at what we do, it's how we do it, too. We embrace each other's differences. We support our community and contribute to a sustainable future for our business and the planet.

If you believe in better, we'll back you all the way.

Just so you know: if your application is successful, we'll ask you to complete a criminal record check. And depending on the role you have applied for and the nature of any convictions you may have, we might have to withdraw the offer

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Maths for Machine Learning Jobs: The Only Topics You Actually Need (& How to Learn Them)

Machine learning job adverts in the UK love vague phrases like “strong maths” or “solid fundamentals”. That can make the whole field feel gatekept especially if you are a career changer or a student who has not touched maths since A level. Here is the practical truth. For most roles on MachineLearningJobs.co.uk such as Machine Learning Engineer, Applied Scientist, Data Scientist, NLP Engineer, Computer Vision Engineer or MLOps Engineer with modelling responsibilities the maths you actually use is concentrated in four areas: Linear algebra essentials (vectors, matrices, projections, PCA intuition) Probability & statistics (uncertainty, metrics, sampling, base rates) Calculus essentials (derivatives, chain rule, gradients, backprop intuition) Basic optimisation (loss functions, gradient descent, regularisation, tuning) If you can do those four things well you can build models, debug training, evaluate properly, explain trade-offs & sound credible in interviews. This guide gives you a clear scope plus a six-week learning plan, portfolio projects & resources so you can learn with momentum rather than drowning in theory.

Neurodiversity in Machine Learning Careers: Turning Different Thinking into a Superpower

Machine learning is about more than just models & metrics. It’s about spotting patterns others miss, asking better questions, challenging assumptions & building systems that work reliably in the real world. That makes it a natural home for many neurodivergent people. If you live with ADHD, autism or dyslexia, you may have been told your brain is “too distracted”, “too literal” or “too disorganised” for a technical career. In reality, many of the traits that can make school or traditional offices hard are exactly the traits that make for excellent ML engineers, applied scientists & MLOps specialists. This guide is written for neurodivergent ML job seekers in the UK. We’ll explore: What neurodiversity means in a machine learning context How ADHD, autism & dyslexia strengths map to ML roles Practical workplace adjustments you can ask for under UK law How to talk about neurodivergence in applications & interviews By the end, you’ll have a clearer sense of where you might thrive in ML – & how to turn “different thinking” into a genuine career advantage.

Machine Learning Hiring Trends 2026: What to Watch Out For (For Job Seekers & Recruiters)

As we move into 2026, the machine learning jobs market in the UK is going through another big shift. Foundation models and generative AI are everywhere, companies are under pressure to show real ROI from AI, and cloud costs are being scrutinised like never before. Some organisations are slowing hiring or merging teams. Others are doubling down on machine learning, MLOps and AI platform engineering to stay competitive. The end result? Fewer fluffy “AI” roles, more focused machine learning roles with clear ownership and expectations. Whether you are a machine learning job seeker planning your next move, or a recruiter trying to build ML teams, understanding the key machine learning hiring trends for 2026 will help you stay ahead.