Lead Data Engineer
Location: South England x2 days a month in office!
Package: Competitive salary + strong benefits
We’re representing a major financial services organisation that is investing heavily in next-generation data and digital platforms. They are building a modern, cloud-native data ecosystem to power AI, analytics, and customer-facing innovation and now seek a Lead Data Engineer to guide this transformation. The company have an incredible Data Leadership team with good tenure, and alongside impactful Data Science projects, they have multiple AI / LLM based projects in production due to their mature Data offering. This is a rare opportunity to join the team at an impactful, senior level due to the typically very long tenure.
The role
This position blends technical leadership with hands-on engineering. You’ll oversee the design and delivery of scalable data solutions, lead and mentor a small engineering group, and set the standards for how data is built, managed, and consumed across the organisation.
It’s a chance to make architectural decisions, work directly with product and AI specialists, and drive forward best practices in a rapidly modernising environment.
Key responsibilities
• Directing major data engineering initiatives and overseeing a team of engineers
• Designing and enhancing data warehouses, pipelines, and integration frameworks at scale
• Partnering with analytics, AI, product, and business teams to create end-to-end data solutions
• Defining coding guidelines, frameworks, and operating models across the platform
• Leading the migration of legacy environments into a flexible, cloud-first stack
• Contributing to the build and delivery of advanced data products and GenAI-enabled applications
• Raising the bar on data quality, governance, and compliance processes
Skills & experience required
• Proven background leading data engineering teams or projects in a technology-driven business
• Expert knowledge of modern cloud data platforms (Databricks, Snowflake, ideally AWS)
• Advanced Python programming skills and fluency with the wider Python data toolkit
• Strong capability with SQL, Spark, Airflow, Terraform, and workflow orchestration tools
• Solid understanding of CICD practices using Git, Jenkins, or equivalent tooling
• Hands-on experience building both batch and streaming data integration pipelines
• Depth in data modelling, ingestion, and optimisation for large-scale environments
• Any exposure to production use of Generative AI is highly advantageous
What’s on offer
• Be a central figure in a large-scale data modernisation programme
• A hybrid working approach that values flexibility
• The opportunity to combine leadership responsibilities with technical delivery
• Influence over the design of next-generation data and AI capabilities within a household-name financial services brand
For this and other data engineering job opportunities, please submit your CV!
