Data Engineering Lead

Elsevier
City of London
4 months ago
Applications closed

Related Jobs

View all jobs

Data Engineering Lead

Data Engineering Lead: Real-Time Pipelines & Mentorship

Data Engineering Lead - Hybrid, Mentorship & Platform

Data Engineering Lead: Cloud Data Pipelines & Scale

Data Engineering Lead

Data Engineering Lead

Data Engineering Lead

Do you enjoy Team Management?


Are you a team player?


Overview

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support science, health education, interactive learning, and exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.


The Team

The Enterprise Data Platforms and Services (EDPS) team is a central technology group responsible for building, administering, governing, and setting global standards for a growing number of Elsevier strategic data platforms and services. The capabilities enable data to be collected, accessed, processed and integrated across digital business solutions used by functions including billing and order management, customer and product master data management, and business analytics and insights delivery. Our footprint across the enterprise ensures systems are trusted, reliable and available. The technology underpinning these capabilities includes Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent, Astronomer/Airflow, and Kubernetes.


This forms part of a longer-term strategic direction to implement Data Mesh and establish shared platforms that enable a connected collection of enterprise-ready time-saving services with a self-service-first approach. Our mission is to enable frictionless experiences for all colleagues, so they can securely consume and produce trustworthy data, enhancing decision-making.


The Role

As the Software Engineering Lead, you will nurture a high-performing cross-functional squad of software and data engineers. This squad supports a growing number of strategic capabilities and components serving many engineering, data science, and analytics use cases and stakeholders. You will be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that supports both operational and analytical use cases.


In practice, this means combining technical expertise with strong stakeholder engagement to understand business needs and design fit-for-purpose solutions. You will map user requirements to platform components and collaborate closely with other technology teams to drive a culture of contributing towards shared services.


Your success will be measured by increases in the number of teams adopting and contributing to the platform capabilities and shared repositories, and improvements in technical efficiency and value.


Key Responsibilities and Accountabilities

  • Accountable for team performance – manage a high performing agile delivery squad, nurturing skills, trust, and relationships through coaching and mentoring.
  • Accountable for releases – set technical development and coding standards for a robust SDLC and review releases to ensure these standards are met.
  • Accountable for shared services – build common frameworks and patterns that are reusable and can be deployed by other teams via self-service.
  • Accountable for best practices – establish guidelines in collaboration with the team, wider engineering groups, architecture, end-users, data product owners, and enablement teams, with regular knowledge-sharing sessions.
  • Accountable for operational efficiency – drive improvements in efficiency, reliability, and scalability with logging, monitoring and observability as foundational capabilities.
  • Responsible for adoption – promote platform capabilities through leadership of technical communities, documented processes, and capturing user feedback.
  • Responsible for platform evolution – collaborate with stakeholders to identify capability gaps and drive change discussions.
  • Responsible for technical governance – establish and manage the technical design authority process for self-service governance of the platform.

Essential Skills & Experience

  • Team leadership – proven line manager and technical lead, focused on coaching and mentoring to motivate cross-functional squads.
  • SDLC – strong understanding of SDLC best practices, with improvements in SDLC and DataOps/DevOps maturity.
  • Agile delivery – facilitating ceremonies, removing impediments, refining requirements, and promoting iterative improvement.
  • Modern data stack – hands-on deployment and governance of enterprise technologies at scale (e.g., Snowflake, Tableau, DBT, Fivetran, Airflow, AWS, GitHub, Terraform) for self-service workloads.
  • Coding languages – Python, JavaScript, and Jinja templating for ETL/ELT data applications, data pipelines, and stored procedures.
  • Thought leadership and influencing – ability to articulate proposals supported by research and value delivery, with experience in driving and adopting change.
  • Solution design and architecture – capable of creating technical design documents and infrastructure artifacts for scalable, secure data platforms with reliable data flow.
  • AWS cloud ecosystem – in-depth knowledge of AWS data and analytics services and production-grade data solutions.
  • Prioritisation – adaptable to changing needs with pragmatic responses to evolving priorities while mitigating impacts.
  • Data and technology governance – applying data management, privacy, and security practices at scale to ensure compliant platform use.

Work in a way that works for you

We promote a healthy work/life balance across the organisation. We offer long-tenured employment prospects and wellbeing initiatives, study assistance, and sabbaticals to support immediate responsibilities and long-term goals.



  • Working remotely from home or in our office in a flexible hybrid style
  • Working flexible hours to fit your productivity patterns

Working with us

We are an equal opportunity employer with a commitment to help you succeed. We foster an inclusive, agile, collaborative, innovative, and fun environment where everyone has a part to play. We value diversity and are committed to a fair hiring process.


Working for you

At Elsevier, wellbeing and happiness are important for a long and successful career. Benefits include:



  • Generous holiday allowance with option to buy additional days
  • Access to learning platforms and time for focused development
  • Health screening, eye care vouchers, and private medical benefits
  • Wellbeing programs
  • Life assurance
  • Competitive contributory pension
  • Long service awards
  • Save As You Earn share option scheme
  • Travel season ticket loan
  • Maternity, paternity and shared parental leave
  • Employee resource groups and volunteering opportunities
  • Extensive learning and development resources
  • Employee discounts via Perks at Work

About the Business

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support science, health education, interactive learning, and clinical practice. At Elsevier, your work contributes to grand challenges and a sustainable future. We pursue innovation to support science and healthcare and partner for a better world.


EEO statement and accessibility details have been provided in the original posting.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.