National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Head of Data Engineering

Cornwallis Elt
London
1 month ago
Applications closed

Related Jobs

View all jobs

Head of Data Engineering & Governance

Head of Data Engineering & Governance

Head of Data Engineering & Analytics

Head of Data Engineering & Governance

Head of Data Engineering & Governance

Head of Data Engineering & Governance

Head of Data Engineering – Databricks, Azure, Data Strategy, Data Governance, Leadership, Management, Azure, Python, ETL, Data Pipelines, Private Markets


A global Private Equity firm are seeking an experienced Head of Data Engineering as part of a critical data transformation and modernisation programme, moving towards a data-first approach. They are currently in the process of replacing a legacy data-warehouse setup with a platform as a service model using Databricks hosted on Azure, which this role will be responsible for leading, taking line management responsibilities for their Data Engineering team.


You will take ownership for progressing their Databricks setup, from its current PoC/incubator phase through to production, ensuring a high level of optimisation and scalability to operate at a global scale.

This will also involve implementing a semantic layer within the platform for effective data management and organisation, as well as the development of associated data pipelines and real-time reporting & visualization capabilities.

Once the platform is in place, the business will then look to apply Data Science techniques with the aim of building a best-in-class data function that works in partnership with the Investment Team and actively provides deep, actionable insights to enable business growth.


The ideal candidate will demonstrate:

  • A technical background in data engineering with experience of technologies including Python, Spark, Databricks and Azure cloud.
  • Previous experience in managing the end-to-end build of an Azure Databricks platform
  • Passionate about all aspects of data (data governance, data quality management etc.) and the positive impact ‘good data’ can bring to a business
  • Demonstrable experience in setting up and managing high-performing technology teams, establishing and driving best practises and being able to still engage at a technical level
  • Able to credibly and confidently engage with the business at all levels
  • A background in Financial Services (Private Markets, Investment Banking, Investment Management) or similarly regulated indsutry such as Gambling/Online Gaming is critical


If you are a data enthusiast with experience in leading high-performing teams to develop modern data platforms, then this is a genuinely exciting time to join a growing business transitioning to a data-first approach.

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

LinkedIn Profile Checklist for Machine Learning Jobs: 10 Tweaks to Drive Recruiter Interest

The machine learning landscape is rapidly evolving, with demand soaring for experts in modelling, algorithm tuning and data-driven insights. Recruiters hunt for candidates proficient in Python, TensorFlow, PyTorch and MLOps processes. A generic profile simply won’t cut it. Our step-by-step LinkedIn for machine learning jobs checklist covers 10 targeted tweaks to ensure your profile ranks in searches and communicates your technical impact. Whether launching your ML career or seeking leadership roles, these optimisations will sharpen your professional narrative and boost recruiter engagement.

Part-Time Study Routes That Lead to Machine Learning Jobs: Evening Courses, Bootcamps & Online Masters

Machine learning—a subset of artificial intelligence—enables computers to learn from data and improve over time without explicit programming. From predictive maintenance in manufacturing to recommendation engines in e-commerce and diagnostic tools in healthcare, machine learning (ML) underpins many of today’s most innovative applications. In the UK, demand for ML professionals—engineers, data scientists, research scientists and ML operations specialists—is growing rapidly, with roles projected to increase by over 50% in the next five years. However, many aspiring ML practitioners cannot step away from work or personal commitments for full-time study. Thankfully, a rich ecosystem of part-time learning pathways—Evening Courses, Intensive Bootcamps and Flexible Online Master’s Programmes—empowers you to learn machine learning while working. This comprehensive guide examines each route: foundational CPD units, immersive bootcamps, accredited online MSc programmes, funding options, planning strategies and a real-world case study. Whether you’re a software developer branching into ML, a statistician aiming to upskill, or a professional exploring AI-driven innovation, you’ll discover how to build in-demand ML expertise on your own schedule.

The Ultimate Assessment-Centre Survival Guide for Machine Learning Jobs in the UK

Assessment centres for machine learning positions in the UK are designed to reflect the complexity and collaboration required in real-world ML projects. From psychometric assessments and live model-building tasks to group data science challenges and behavioural interviews, recruiters evaluate your statistical understanding, coding skills, communication and teamwork. Whether you specialise in deep learning, reinforcement learning or NLP, this guide offers a step-by-step approach to excel at every stage and secure your next ML role.