Head of Data Engineering - Private Markets - London/Hybrid | London, UK

twentyAI
London
1 day ago
Create job alert

Head of Data Engineering - Private Markets - London/Hybrid

An exciting opportunity has arisen for an experienced data engineering leader to drive innovation and build a best-in-class data infrastructure at a leading private markets firm. This role will lead a high-performing team in designing and scaling data platforms, with a strong emphasis onAzure Databricks, to enhance investment decision-making and operational efficiency.

The Role

AsHead of Data Engineering, you will be responsible for shaping and executing the firm’s data strategy, working closely with stakeholders across technology, investment, and transformation teams. Your expertise indata architecture, cloud platforms, and engineering best practiceswill be instrumental in building scalable, high-performance data solutions that power analytics and business intelligence.

Key Responsibilities

  1. Lead and develop the data engineering team, fostering a culture of technical excellence and innovation.
  2. Architect and build scalable data pipelines, integrating structured and unstructured data sources to support investment research and reporting.
  3. Drive the firm’s cloud-based data strategy, optimizing data storage, processing, and compute efficiency using Azure Synapse, Databricks, and Spark.
  4. Collaborate with investment and technology teams to develop analytical capabilities, enabling advanced insights and automation.
  5. Monitor emerging data engineering trends, tools, and best practices to keep the firm at the cutting edge of technology.
  6. Define and track key performance indicators (KPIs) to measure the impact of data initiatives.

Requirements

  1. Proven leadership experience in data engineering, data architecture, or analytics, ideally within investment management, financial services, or private markets.
  2. Strong expertise in Azure cloud services, Synapse, Databricks, Spark, and data lake architectures.
  3. Deep understanding of ETL/ELT processes, data modeling, and high-performance data warehousing.
  4. Experience managing large-scale data platforms and optimizing data pipelines for analytics and reporting.
  5. Strong strategic mindset with the ability to translate technical capabilities into business value.
  6. Excellent communication and stakeholder management skills, with the ability to influence senior leadership and drive cross-functional collaboration.

This is a unique opportunity to shape the future of data engineering within a dynamic investment environment. If you’re a forward-thinking data leader with expertise in Synapse, Databricks, and cloud-based data solutions, I’d love to hear from you.

J-18808-Ljbffr

Related Jobs

View all jobs

Head of Data - Engineering - AI & Data Science

Head of Engineering

Head of Data Engineering & Architecture

Head of Data and Analytics Engineering

Head of Data and Analytics Engineering

Head of Data and Analytics Engineering

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Books to Advance Your Machine Learning Career in the UK

Machine learning (ML) remains one of the fastest-growing fields within technology, reshaping industries across the UK from finance and healthcare to e-commerce, telecommunications, and beyond. With increasing demand for ML specialists, job seekers who continually update their knowledge and skills hold a significant advantage. In this article, we've curated ten essential books every machine learning professional or aspiring ML engineer in the UK should read. Covering foundational theory, practical implementations, advanced techniques, and industry trends, these resources will equip you to excel in your machine learning career.

Navigating Machine Learning Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Machine learning (ML) has swiftly become one of the most in-demand skill areas across industries, with companies leveraging predictive models and data-driven insights to solve challenges in healthcare, finance, retail, manufacturing, and beyond. Whether you’re an early-career data scientist aiming to break into ML, a seasoned engineer branching into deep learning, or a product manager exploring AI-driven solutions, machine learning career fairs offer a powerful route to connect with prospective employers face-to-face. Attending these events can help you: Network with hiring managers and technical leads who make direct recruitment decisions. Gain insider insights on the latest ML trends and tools. Learn about emerging job roles and new industry verticals adopting machine learning. Showcase your interpersonal and communication skills, both of which are increasingly important in collaborative AI/ML environments. However, with many applicants vying for attention in a bustling hall, standing out isn’t always easy. In this detailed guide, we’ll walk you through how to prepare meticulously, pitch yourself confidently, ask relevant questions, and follow up effectively to land the machine learning opportunity that aligns with your ambitions.

Common Pitfalls Machine Learning Job Seekers Face and How to Avoid Them

Machine learning has emerged as one of the most sought-after fields in technology, with companies across industries—from retail and healthcare to finance and manufacturing—embracing data-driven solutions at an unprecedented pace. In the UK, the demand for skilled ML professionals continues to soar, and opportunities in this domain are abundant. Yet, amid this growing market, competition for machine learning jobs can be fierce. Prospective employers set a high bar: they seek candidates with not just theoretical understanding, but also strong practical skills, business sense, and an aptitude for effective communication. Whether you’re a recent graduate, a data scientist transitioning into machine learning, or a seasoned developer pivoting your career, it’s essential to avoid common mistakes that may hinder your prospects. This blog post explores the pitfalls frequently encountered by machine learning job seekers, and offers actionable guidance on how to steer clear of them. If you’re looking for roles in this thriving sector, don’t forget to check out Machine Learning Jobs for the latest vacancies across the UK. In this article, we’ll break down these pitfalls to help you refine your approach in applications, interviews, and career development. By taking on board these insights, you can significantly enhance your employability, stand out from the competition, and secure a rewarding position in the world of machine learning.