National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Lead Data Engineer

Live Nation (Music) UK Limited
London
2 days ago
Create job alert

THE JOB

We are looking for a highly skilled Lead Data Engineer to design, develop, and maintain our cloud-based data infrastructure, with a strong focus on Databricks. In this key leadership role, you will drive the architecture, implementation, and optimisation of our data platform, enabling robust data pipelines and analytics capabilities that power business-critical insights and real-time operations.

You will collaborate cross-functionally with engineering, product, and analytics teams to ensure data availability, quality, and performance, while also mentoring a team of data engineers and contributing to the long-term technical vision.

Please note: As our platform operates 24/7, occasional out-of-hours work and on-call support may be required as part of a rota.

WHAT YOU WILL BE DOING

Lead the architectural design, implementation, and ongoing optimization of our international data platform, aligned with enterprise-wide standards. Build and maintain scalable ETL/ELT data pipelines using Databricks, Spark, and related technologies. Optimize Databricks clusters, workflows, and jobs to ensure cost efficiency and high performance. Design and manage data lakes, data warehouses, and associated infrastructure to ensure data accuracy, integrity, and availability. Write high-quality, efficient code in Scala, Python, and Spark, following best practices for maintainability and scalability. Develop and implement robust monitoring, alerting, and error-handling mechanisms to ensure pipeline reliability. Partner with business stakeholders, product managers, analysts, and engineers to understand data needs and deliver effective solutions.  Lead technical discussions, guide architectural decisions, and clearly communicate complex data concepts to both technical and non-technical audiences. Mentor and support the professional growth of data engineers within the team. Enforce strong standards for data governance, security, privacy, and compliance. Maintain comprehensive documentation of data systems, pipelines, and processes. Provide on-call support as part of a shared team rota to ensure platform availability.

ABOUT YOU

Proven expertise working with Databricks, including Unity Catalog. Strong programming skills in Scala, Python, Spark & SQL/MYSQL. Solid experience with version control systems, particularly Git. Strong background in designing and optimizing complex data pipelines and infrastructure. Experience leading and mentoring technical teams of data engineers. Deep understanding of data warehousing, ETL/ELT patterns, and real-time data processing. Strong problem-solving and analytical skills, with meticulous attention to detail. Ability to work proactively, identify challenges, and implement improvements. Excellent communication skills with the ability to explain complex data concepts to both technical and non-technical audiences. Collaborative mindset, capable of working cross-functionally in a fast-paced, evolving environment. Eagerness to learn and adapt to emerging technologies.

A job description is a written statement of the essential characteristics job, with its principal responsibilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects the duties and skills involved. #LI-JCK #LI-Hybrid

Related Jobs

View all jobs

Lead Data Engineer - Multi-Strat Fund - Research Platform - £300k

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Present Machine Learning Solutions to Non-Technical Audiences: A Public Speaking Guide for Job Seekers

Machine learning is driving change across nearly every industry—from retail and finance to health and logistics. But while the technology continues to evolve rapidly, the ability to communicate it clearly has become just as important as building the models themselves. Whether you're applying for a junior ML engineer role, a research position, or a client-facing AI consultant job, UK employers increasingly expect candidates to explain complex machine learning solutions to non-technical audiences. In this guide, you’ll learn how to confidently present your work, structure your message, use simple visuals, and explain the real-world value of machine learning in a way that makes sense to people without a background in data science.

Machine Learning Jobs UK 2025: 50 Companies Hiring Now

Bookmark this page—we refresh the Hotlist every quarter so you always know who’s really scaling their ML teams. The UK’s National AI Strategy, a £2 billion GenAI accelerator fund and a record flow of private capital have kicked ML hiring into overdrive for 2025. Whether you build production‑grade LLM services or optimise on‑device models for edge hardware, employers need your skills now. Below you’ll find 50 organisations that advertised UK‑based machine‑learning vacancies or announced head‑count growth during the past eight weeks. They’re grouped into five quick‑scan categories so you can jump straight to the type of employer—and mission—that excites you. For each company we list: Main UK hub Example live or recent vacancy Why it’s worth a look (stack, impact, culture) Search any employer on MachineLearningJobs.co.uk to see real‑time adverts, or set a free alert so fresh openings drop straight in your inbox.

Return-to-Work Pathways: Relaunch Your Machine Learning Career with Returnships, Flexible & Hybrid Roles

Returning to work after an extended break can feel like starting from scratch—especially in a specialist field like machine learning. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s machine learning sector now offers a variety of return-to-work pathways. From structured returnships to flexible and hybrid roles, these programmes recognise the transferable skills and resilience you’ve developed, pairing you with mentorship, upskilling and supportive networks to ease your transition back. In this guide, you’ll discover how to: Understand the current demand for machine learning talent in the UK Leverage your organisational, communication and analytical skills in ML contexts Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to machine learning Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your career relaunch with caring responsibilities Master applications, interviews and networking specific to ML Learn from inspiring returner success stories Get answers to common questions in our FAQ section Whether you aim to return as an ML engineer, research scientist, MLOps specialist or data scientist with an ML focus, this article will map out the steps and resources you need to reignite your machine learning career.