Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Lead Data Engineer

TPXimpact Ltd
City of London
4 days ago
Create job alert
Overview

About The Role


Job level: 10


Deadline for applications: 11:59pm on Sunday 26th October.


We’re looking for a Lead Data Engineer to join our Data Engineering and Analytics practice.


In this role, you will:



  • Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to reuse data flows where possible.
  • Coordinate teams and set best practices and standards when it comes to data engineering principles.
  • Champion data engineering across projects and clients.

Responsibilities

  • Lead by example, holding responsibilities for team culture, and how projects deliver the most impact and value to our clients.
  • Be accountable for the strategic direction, delivery and growth of our work.
  • Lead teams, strands of work and outcomes, owning commercial responsibilities.
  • Hold and manage uncertainty and ambiguity on behalf of clients and our teams.
  • Ensure teams and projects are inclusive through how you lead and manage others.
  • Effectively own and hold the story of our work, ensuring we measure progress against client goals and our DT missions.
  • Work with our teams to influence and own how we deliver more value to clients, working with time and budget constraints.
  • Strategically plan the overall project and apply methods and approaches.
  • Demonstrably share work with wider audiences.
  • Elevate ideas through how you write, speak and present.

About You

Professional knowledge and experience


Essential



  • Proven experience in data engineering, data integration and data modelling
  • Expertise with cloud platforms (e.g. AWS, Azure, GCP)
  • Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks)
  • Expertise with multiple data analytics tools (e.g. Power BI)
  • Deep understanding of data warehousing concepts, ETL/ELT pipelines and dimensional modelling
  • Proficiency in advanced programming languages (Python/PySpark, SQL)
  • Experience in data pipeline orchestration (e.g. Airflow, Data Factory)
  • Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc)
  • Ability to communicate technical concepts to both technical and non-technical audiences
  • Proven experience in delivery of complex projects in a fast paced environment with tight deadlines

Desirable



  • Advanced knowledge of data governance, data standards and best practices.
  • Experience in a consultancy environment, demonstrating flexibility and adaptability to client needs.
  • Experience defining and enforcing data engineering standards, patterns, and reusable frameworks
  • Professional certifications in relevant technologies (e.g. Microsoft Azure Data Engineer, AWS Data Analytics, Databricks Certified Professional Data Engineer)

Skills

Data Development Process



  • Design, build and test data products that are complex or large scale
  • Build and lead teams to complete data integration services integration and reusable pipelines that meet performance, quality and scalability standards
  • Collaborate with architects to align solutions with enterprise data strategy and target architectures

Data Engineering and Manipulation



  • Work with data analysts, engineers and data science and AI specialists to design and deliver products into the organisation effectively.
  • Understand the reasons for cleansing and preparing data before including it in data products and can put reusable processes and checks in place.
  • Access and use a range of architectures (including cloud and on-premise) and data manipulation and transformation tools deployed within the organisation.
  • Optimise data pipelines and queries for performance and cost efficiency in distributed environments

Testing (Data)



  • Review requirements and specifications, and define system integration testing conditions for complex data products and support others to do the same
  • Identify and manage issues and risks associated with complex data products and support others to do the same
  • Analyse and report system test activities and results for complex data products and support others to do the same

Other Skills



  • Proficiency in developing and maintaining complex data models (conceptual, logical and physical).
  • Strong skills in data governance and metadata management.
  • Experience with data integration design and implementation.
  • Ability to write efficient, maintainable code for large scale data systems.
  • Experience with CI/CD pipelines, version control, and infrastructure-as-code (e.g. Git, Azure DevOps).
  • Strong stakeholder communication skills, with the ability to translate technical concepts into business terms.
  • Ability to mentor junior engineers, foster collaboration, and build a high-performing data engineering culture.

Behaviours and PACT values

  • Purpose: Be values-driven, recognising that our client's needs are paramount. Approach client engagements with professionalism and creativity, balancing commercial and operational needs.
  • Accountability: Be accountable for delivering your part of a project on time and under budget and working well with other leaders. Lead by example, promoting a culture where quality and client experience are foremost.
  • Craft: Balance multiple priorities while leading high-performing teams. Navigate ambiguity and set the technical direction and approach to support positive outcomes.
  • Togetherness: Collaborate effectively with others across TPXimpact. Build strong relationships with colleagues and clients.

About Us
People-Powered Transformation

We\'re a purpose driven organisation, supporting organisations to build a better future for people, places and the planet. Combining vast experience in the public, private and third sectors and expertise in human-centred design, data, experience and technology, we’re creating sustainable solutions ready for an ever-evolving world.


At the heart of TPXimpact, we’re collaborative and empathetic. We’re a team of passionate people who care deeply about the work we do and the impact we have in the world. We know that change happens through people, with people and for people. That’s why we believe in people-powered transformation.


Working in close collaboration with our clients, we seek to understand their unique challenges, questioning assumptions and building in their teams the capabilities and confidence to continue learning, iterating and adapting.


Benefits Include:



  • 30 days holiday + bank holidays
  • 2 volunteer days for causes that you are passionate about
  • Maternity/paternity - 6 months Maternity Leave, 3 months Paternity Leave
  • Life assurance
  • Employer pension contribution of 5%
  • Health cash plan
  • Personal learning and development budget
  • Employee Assistance Programme
  • Access to equity in the business through a Share Incentive Plan
  • Green incentive programmes including Electric Vehicle Leasing and the Cycle to Work Scheme
  • Financial advice
  • Health assessments

About TPXimpact - Digital Transformation

We drive fundamental change in approaches to product and service development, delivery and technology. Our agile, multidisciplinary teams use technology, design and data to deliver better results, improving outcomes for individuals, organisations and communities.


By working in the open, in partnership with our clients, we not only transform their systems and services but also build the capability of their teams, so work can continue without us in the longer term. Our focus is sustainable change, always delivered with positive impact.


We’re an inclusive employer, and we care about diversity in our teams. Let us know in your application if you have accessibility requirements during the interview.


#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Reigate

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.

Why the UK Could Be the World’s Next Machine Learning Jobs Hub

Machine learning (ML) is becoming essential to industries across the globe—from finance and healthcare to retail, logistics, defence, and the public sector. Its ability to uncover patterns in data, make predictions, drive automation, and increase operational efficiency has made it one of the most in-demand skill sets in the technology world. In the UK, machine learning roles—from engineers to researchers, product managers to analysts—are increasingly central to innovation. Universities are expanding ML programmes, enterprises are scaling ML deployments, and startups are offering applied ML solutions. All signs point toward a surging need for professionals skilled in modelling, algorithms, data pipelines, and AI systems. This article explores why the United Kingdom is exceptionally well positioned to become a global machine learning jobs hub. It examines the current landscape, strengths, career paths, sector-specific demand, challenges, and what must happen for this vision to become reality.