Lead Data Engineer

Lead Data Engineer ( Databricks )
London - Hybrid - Remote
Permanent
£100,000 - £130,000 plus up to 20% bonus based on performance and commercial contribution

About the Role

We’re looking for a Lead Data Engineer to spearhead some of our clients most strategic Databricks engagements.

This is a senior client-facing leadership role, blending hands-on technical delivery with architectural design and pre-sales influence.

You'll be leading high-performing squads, guiding complex transformations, and working directly with senior stakeholders to bridge business needs and engineering excellence — particularly in industries like manufacturing, utilities, and aviation.

This is a key hire to support our clients expanding Databricks practice, to build capacity for future growth.

What You’ll Be Doing

• Act as the technical lead on client engagements, owning design and delivery of data solutions in Databricks.
  
  
• Architect robust, scalable data platforms using the medallion architecture.
  
  
• Translate business requirements into scalable workflows, advising on data governance, quality, and security.
  
  
• Design and implement complex data pipelines using tools like Delta Live Tables (DLT) and Unity Catalog.
  
  
• Guide teams in implementing best practices across engineering, DevOps, and model deployment.
  
  
• Support pre-sales activity, including shaping proposals, estimates, and technical roadmaps.
  
  
• Provide technical leadership, mentorship, and oversight to squads of Senior and Associate Engineers.
  
  
• Collaborate closely with Platform Engineers and Platform Architects to align infrastructure with data needs.
  
  
• Contribute to growing the Databricks capability – from delivery frameworks to internal tooling and capability development.
  
  
• Lead a team of data engineers, fostering a collaborative and growth-oriented environment.
  
  
• Evaluate new data engineering technologies and strategies, assessing their relevance and fit for the organisation’s strategic goals.
  
  
• Work closely with the commercial team to scope projects and develop proposals that align technical capabilities with client requirements.
  
  Essential Skills & Experience
  
  
• 8+ years in data engineering, with at least 2+ in a technical leadership role
  
  
• Proven experience designing and leading Databricks-based data platforms
  
  
• Deep understanding of the medallion architecture, data lakehouse design, and transformation workflows
  
  
• Hands-on expertise with DLT, Unity Catalog, and model deployment frameworks
  
  
• Strong communication and consulting skills – able to lead client conversations and manage stakeholders
  
  
• Experience in agile delivery environments and cross-functional teams
  
  
• Commercial awareness – comfortable contributing to pre-sales, growing accounts, and engaging with commercial targets
  
  Desirable Skills
  
  
• Experience in physical asset-heavy industries (e.g. utilities, manufacturing, aviation)
  
  
• Familiarity with platform and DevOps collaboration, especially on AWS or Azure
  
  
• Certifications in Databricks or cloud platforms (AWS/Azure)
  
  
• Background in consulting or client delivery environments
  
  Why Join?
  
  
• Join a consultancy that’s doubling down on Databricks with enterprise-grade delivery
  
  
• Be the go-to technical leader on projects with real-world business impact
  
  
• Shape the future of our Databricks workforce strategy and delivery model
  
  
• Career progression into Delivery Lead, Practice Lead, or Pre-Sales Specialist
  
  
• Competitive compensation and strong bonus structure, aligned with delivery and commercial impact
  
  To find out more about this high profile Lead Data Engineering position, click apply