Lead Data Engineer (Kafka/Kinesis)

Harnham - Data and Analytics Recruitment
London, United Kingdom
Yesterday
£90,000 – £100,000 pa

Salary

£90,000 – £100,000 pa

Job Type
Permanent
Work Pattern
Full-time
Work Location
On-site
Seniority
Lead
Education
Degree
Visa Sponsorship
Available
Posted
8 Jul 2026 (Yesterday)

Benefits

25 days holiday Pension Private healthcare Remote allowance

Lead Data Engineer

Up to £100,000

*Kafka or Kinesis required
London (4 days onsite)

This is a great opportunity to join a high-growth organisation where you can take ownership of building and architecting a greenfield data platform for an AI-driven product.

THE COMPANY:

This is an early-stage, venture-backed company building the operating system for modern property management through its AI platform.

THE ROLE:

You will take ownership of the entire data architecture, acting as the most senior individual contributor within Data Engineering. This is a hands-on leadership role focused on technical ownership rather than people management.

Key responsibilities include:

  • Designing and owning the company's data architecture from the ground up
  • Building scalable batch and real-time data pipelines
  • Developing data ingestion, storage, and transformation frameworks
  • Supporting AI and machine learning infrastructure, including vector search systems
  • Implementing data quality, monitoring, and observability practices
  • Collaborating closely with AI, backend engineering, and product teams
  • Optimising performance, scalability, and reliability of large datasets
  • Influencing long-term technical strategy and laying foundations for the data function
YOUR SKILLS AND EXPERIENCE:

You will bring strong capability in:

  • Python development and building scalable distributed data systems
  • Data architecture design and pipeline development
  • Batch and streaming data processing
  • Relational databases (PostgreSQL or similar)
  • NoSQL and modern vector databases (e.g., Qdrant, Milvus, pgvector)
THE BENEFITS:

You will receive a salary of up to £100,000 depending on experience.

HOW TO APPLY:

Please register your interest by sending your CV to Molly Bird via the apply link on this page.

Related Jobs

View all jobs
Spotlight

Senior Machine Learning Scientist

Chattermill London, United Kingdom
Remote
Spotlight

ML Runtime Engineer (Mid-Level and Senior)

Fractile London, United Kingdom
Hybrid

Lead Data Engineer

Lloyds Banking Group Edinburgh, Alba / Scotland, United Kingdom
£92,701 – £109,060 pa Hybrid Clearance Required

Lead Data Engineer

The Hyde Se19Eq, SE1 9EQ, United Kingdom
£80,000 pa Hybrid

Lead Data Engineer

The Hyde Se13Ny, SE1 3NY, United Kingdom
£68,000 – £80,400 pa On-site

Lead Data Engineer

Sphere Digital Recruitment London, United Kingdom
£75,000 pa Hybrid

Lead Data Engineer (Kafka/Kinesis)

Harnham - Data and Analytics Recruitment London, United Kingdom
£90,000 – £100,000 pa On-site

Lead Data Scientist

Yolk Recruitment Cardiff, Cymru / Wales, CF10 2AF, United Kingdom
£100,000 – £110,000 pa Hybrid

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.