National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Data Engineer - Team Lead

Confluent
London
1 week ago
Create job alert

Business Technology & Data United Kingdom
With Confluent, organisations can harness the full power of continuously flowing data to innovate and win in the modern digital world. We have a purpose that drives us to do better every day – we're creating an entirely new category within data infrastructure - data streaming. This technology will allow every organisation to create experiences and use the power of data in ways that profoundly impact the way we all live. This impact is our purpose and drives us to do better every day.
One Confluent. One team. One Data Streaming Platform.
Data Connects Us.
About the Role:
The mission of the Data Science/Data Engineering team at Confluent is to serve as the central nervous system of all things data for the company: we build data and analytics infrastructure, insights, models and tools, to empower data-driven thinking, and optimize every part of the business. This position offers limitless opportunities for an ambitious data engineering leader to make an immediate and meaningful impact within a hyper-growth start-up, and contribute to a highly engaged open source community.

This is a partnership-heavy role. As a Team Lead within the Data organization, you will enable various functions of the company, i.e. Product, Engineering, Field Operations, Go-to-Market, etc., to be data-driven while providing leadership and direction to your team. As a Data Engineer, you will take on big data challenges in an agile way. You will participate and guide your team in building data pipelines that enable data scientists, analytics partners, operation teams, and executives to make data accessible to the entire company. You will also build data models to deliver insightful analytics while ensuring the highest standard in data integrity. You are encouraged to think out of the box and play with the latest technologies while exploring their limits. Successful candidates will have strong technical capabilities, leadership experience, a can-do attitude, and are highly collaborative.
What You Will Do:
Lead a team of data engineers, providing technical guidance, mentorship, and career development
Partner with stakeholders across the organization to understand business needs, prioritize features, and develop strategic data solutions
Break down complex projects into manageable tasks and assign them to team members based on their strengths and development goals
Design, build and launch extremely efficient and reliable data pipelines to move data across many platforms including Data Warehouse and real-time systems
Develop strong subject matter expertise and manage the SLAs for those data pipelines
Set up and improve BI tooling and platforms to help the team create dynamic tools and reporting
Partner with Data Scientists and business partners to develop internal data products to improve operational efficiencies organizationally
Foster a culture of innovation, collaboration, and technical excellence within your team
Represent the data engineering team in cross-functional meetings and advocate for technical best practices
What You Will Bring:
6+ years of experience in a Data Engineering role, with a focus on data warehouse technologies, data pipelines, and BI tooling
1-3 years of team leadership, management, or equivalent project leadership experience (formal management preferred, but will consider dotted line management or technical leadership roles)
Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Engineering, or related technical discipline
Expert knowledge of SQL and relational & cloud database systems and concepts
Strong knowledge of data architectures, data modelling and data infrastructure ecosystem
Experience with enterprise business systems such as Salesforce, Marketo, Zendesk, Clari, Anaplan, etc
Experience with ETL pipeline tools like Airflow, and DBT, and with code version control systems like Git
Demonstrated ability to see the big picture and translate business needs into technical requirements
Strong stakeholder management skills and ability to effectively prioritize competing demands
The ability to communicate cross-functionally, derive requirements and architect shared datasets; the ability to synthesize, simplify, and explain complex problems to different types of audiences, including executives
Proven track record of mentoring junior engineers and helping them grow technically
The ability to thrive in a dynamic environment. That means being flexible and willing to jump in and do whatever it takes to be successful
What Gives You an Edge:
Experience with Apache Kafka
Knowledge of batch and streaming data architectures
Product mindset to understand business needs, and come up with scalable engineering solutions
Previous experience scaling data teams and establishing data engineering best practices
Experience balancing technical debt with new feature development
Success in translating business objectives into actionable technical roadmaps
Come As You Are
At Confluent, equality is a core tenet of our culture. We are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact. Employment decisions are made on the basis of job-related criteria without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by applicable law.
Click HERE to review our Candidate Privacy Notice which describes how and when Confluent, Inc., and its group companies, collects, uses, and shares certain personal information of California job applicants and prospective employees.
#LI-Remote

#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Azure - Leeds

Senior Data Engineer - Snowflake - £100,000 - London - Hybrid

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Present Machine Learning Solutions to Non-Technical Audiences: A Public Speaking Guide for Job Seekers

Machine learning is driving change across nearly every industry—from retail and finance to health and logistics. But while the technology continues to evolve rapidly, the ability to communicate it clearly has become just as important as building the models themselves. Whether you're applying for a junior ML engineer role, a research position, or a client-facing AI consultant job, UK employers increasingly expect candidates to explain complex machine learning solutions to non-technical audiences. In this guide, you’ll learn how to confidently present your work, structure your message, use simple visuals, and explain the real-world value of machine learning in a way that makes sense to people without a background in data science.

Machine Learning Jobs UK 2025: 50 Companies Hiring Now

Bookmark this page—we refresh the Hotlist every quarter so you always know who’s really scaling their ML teams. The UK’s National AI Strategy, a £2 billion GenAI accelerator fund and a record flow of private capital have kicked ML hiring into overdrive for 2025. Whether you build production‑grade LLM services or optimise on‑device models for edge hardware, employers need your skills now. Below you’ll find 50 organisations that advertised UK‑based machine‑learning vacancies or announced head‑count growth during the past eight weeks. They’re grouped into five quick‑scan categories so you can jump straight to the type of employer—and mission—that excites you. For each company we list: Main UK hub Example live or recent vacancy Why it’s worth a look (stack, impact, culture) Search any employer on MachineLearningJobs.co.uk to see real‑time adverts, or set a free alert so fresh openings drop straight in your inbox.

Return-to-Work Pathways: Relaunch Your Machine Learning Career with Returnships, Flexible & Hybrid Roles

Returning to work after an extended break can feel like starting from scratch—especially in a specialist field like machine learning. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s machine learning sector now offers a variety of return-to-work pathways. From structured returnships to flexible and hybrid roles, these programmes recognise the transferable skills and resilience you’ve developed, pairing you with mentorship, upskilling and supportive networks to ease your transition back. In this guide, you’ll discover how to: Understand the current demand for machine learning talent in the UK Leverage your organisational, communication and analytical skills in ML contexts Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to machine learning Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your career relaunch with caring responsibilities Master applications, interviews and networking specific to ML Learn from inspiring returner success stories Get answers to common questions in our FAQ section Whether you aim to return as an ML engineer, research scientist, MLOps specialist or data scientist with an ML focus, this article will map out the steps and resources you need to reignite your machine learning career.