Engineer the Quantum RevolutionYour expertise can help us shape the future of quantum computing at Oxford Ionics.

View Open Roles

Lead Data Engineer

Live Nation Entertainment
London
1 month ago
Create job alert

Job Summary:

LEAD DATA ENGINEER

Location: London (Hybrid)

Division: Live Nation International

Contract Terms: Permanent

ABOUT LIVE NATION

The Live Nation Digital Tech Team (LNDT) drives the fan experience across 36 international Live Nation sites, covering 59 countries and 33 languages. We are truly responsible for the online face of the business and are the team who help fans discover and buy the tickets they just cannot miss out on. As well as our core business with the Live Nation sites, we support and manage over 200 festival and venue sites who work independently but within our framework and we are required to meet their needs whilst allowing them autonomy.

THE JOB

We are looking for a highly skilled Lead Data Engineer to design, develop, and maintain our cloud-based data infrastructure, with a strong focus on Databricks. In this key leadership role, you will drive the architecture, implementation, and optimisation of our data platform, enabling robust data pipelines and analytics capabilities that power business-critical insights and real-time operations.

You will collaborate cross-functionally with engineering, product, and analytics teams to ensure data availability, quality, and performance, while also mentoring a team of data engineers and contributing to the long-term technical vision.

Please note: As our platform operates 24/7, occasional out-of-hours work and on-call support may be required as part of a rota.

WHAT YOU WILL BE DOING

  • Lead the architectural design, implementation, and ongoing optimization of our international data platform, aligned with enterprise-wide standards.
  • Build and maintain scalable ETL/ELT data pipelines using Databricks, Spark, and related technologies.
  • Optimize Databricks clusters, workflows, and jobs to ensure cost efficiency and high performance.
  • Design and manage data lakes, data warehouses, and associated infrastructure to ensure data accuracy, integrity, and availability.
  • Write high-quality, efficient code in Scala, Python, and Spark, following best practices for maintainability and scalability.
  • Develop and implement robust monitoring, alerting, and error-handling mechanisms to ensure pipeline reliability.
  • Partner with business stakeholders, product managers, analysts, and engineers to understand data needs and deliver effective solutions.
  • Lead technical discussions, guide architectural decisions, and clearly communicate complex data concepts to both technical and non-technical audiences.
  • Mentor and support the professional growth of data engineers within the team.
  • Enforce strong standards for data governance, security, privacy, and compliance.
  • Maintain comprehensive documentation of data systems, pipelines, and processes.
  • Provide on-call support as part of a shared team rota to ensure platform availability.

ABOUT YOU

  • Proven expertise working with Databricks, including Unity Catalog.
  • Strong programming skills in Scala, Python, Spark & SQL/MYSQL.
  • Solid experience with version control systems, particularly Git.
  • Strong background in designing and optimizing complex data pipelines and infrastructure.
  • Experience leading and mentoring technical teams of data engineers.
  • Deep understanding of data warehousing, ETL/ELT patterns, and real-time data processing.
  • Strong problem-solving and analytical skills, with meticulous attention to detail.
  • Ability to work proactively, identify challenges, and implement improvements.
  • Excellent communication skills with the ability to explain complex data concepts to both technical and non-technical audiences.
  • Collaborative mindset, capable of working cross-functionally in a fast-paced, evolving environment.
  • Eagerness to learn and adapt to emerging technologies.

A job description is a written statement of the essential characteristics job, with its principal responsibilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects the duties and skills involved. #LI-JCK #LI-Hybrid


#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer...

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.

Why Now Is the Perfect Time to Launch Your Career in Machine Learning: The UK's Intelligence Revolution

The United Kingdom stands at the epicentre of a machine learning revolution that's fundamentally transforming how we solve problems, deliver services, and unlock insights from data at unprecedented scale. From the AI-powered diagnostic systems revolutionising healthcare in Manchester to the algorithmic trading platforms driving London's financial markets, Britain's embrace of intelligent systems has created an extraordinary demand for skilled machine learning professionals that dramatically exceeds the current talent supply. If you've been seeking a career at the forefront of technological innovation or looking to position yourself in one of the most impactful sectors of the digital economy, machine learning represents an exceptional opportunity. The convergence of abundant data availability, computational power accessibility, advanced algorithmic development, and enterprise AI adoption has created perfect conditions for machine learning career success.

Automate Your Machine Learning Jobs Search: Using ChatGPT, RSS & Alerts to Save Hours Each Week

ML jobs are everywhere—product companies, labs, consultancies, fintech, healthtech, robotics—often hidden in ATS portals or duplicated across boards. The fastest way to stay on top of them isn’t more scrolling; it’s automation. With keyword-rich alerts, RSS feeds, and a reusable ChatGPT workflow, you can bring relevant roles to you, triage them in minutes, and tailor strong applications without burning your evenings. This is a copy-paste playbook for www.machinelearningjobs.co.uk readers. It’s UK-centric, practical, and designed to save you hours each week. What You’ll Have Working In 30 Minutes A role & keyword map spanning LLM/NLP, Vision, Core ML, Recommenders, MLOps/Platform, Research/Applied Science, and Edge/Inference optimisation. Shareable Boolean searches you can paste into Google & job boards to cut noise. Always-on alerts & RSS feeds delivering fresh roles to your inbox/reader. A ChatGPT “ML Job Scout” prompt that deduplicates, scores fit, and outputs tailored actions. A lightweight pipeline tracker so deadlines and follow-ups never slip.