Data Engineering Lead

Butterworths Limited Company
home based, united kingdom
7 months ago
Create job alert

About the Role


 

As the technical lead for the team building the strategic Data Platform at LexisNexis IP, you will be instrumental in executing our data strategy for the Data Platform. Your role will be pivotal in developing and implementing advanced solutions for data integration, quality control, and continuous delivery, driving our data operations to new heights.

Your expertise will be crucial in embedding best practices and state-of-the-art data engineering tools, ensuring that our workflows are both efficient and scalable.

Responsibilities
 

Architecting and leading the development of our patent data ingestion pipeline using Databricks, Python, and PySpark. Mentoring and guiding a team of data engineers, fostering a collaborative environment that encourages growth and innovation. You will enable and lead technical discussions within the team and with stakeholders Ensuring the pipeline is efficient, scalable, and robust, capable of handling terabytes of data with low latency. Eliminate inefficiencies and teach the techniques to the team. Contributing to the overall data engineering strategy and drive the adoption of best practices in coding, architecture, and deployment. Identifying and resolving technical challenges, ensuring the smooth operation of the data ingestion pipeline. Automating the boring stuff, and make space for the team to tackle the most challenging up and coming problems.


Requirements
 

Demonstrate expertise in Python, and PySpark is essential for you to lead the skill up the team. Demonstrate expertise in Databricks would be highly desirable and advantageous. Demonstrate ability to design and implement scalable data architectures for both batch and streaming data processing. Demonstrate proficiency in using cloud platforms such as AWS, Azure, or Google Cloud for data infrastructure management Knowledge of data governance practices, including data quality management, metadata management, and data lineage Proven experience in leading and mentoring technical data engineering teams.


Work in a way that works for you
 

We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.
 

Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive


Working for you
 

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer
 

Generous holiday allowance with the option to buy additional days Health screening, eye care vouchers and private medical benefits Wellbeing programs Life assurance Access to a competitive contributory pension scheme Save As You Earn share option scheme Travel Season ticket loan Electric Vehicle Scheme Optional Dental Insurance Maternity, paternity and shared parental leave Employee Assistance Programme Access to emergency care for both the elderly and children RECARES days, giving you time to support the charities and causes that matter to you Access to employee resource groups with dedicated time to volunteer Access to extensive learning and development resources Access to employee discounts scheme via Perks at Work

Related Jobs

View all jobs

Global Data Engineering Lead

Lead data Engineer - Financial Markets - Day rate

Software Team Manchester

Data Architect - Contract

Data Engineer Lead

Databricks Tech Lead

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine‑Learning Jobs for Non‑Technical Professionals: Where Do You Fit In?

The Model Needs More Than Math When ChatGPT went viral and London start‑ups raised seed rounds around “foundation models,” many professionals asked, “Do I need to learn PyTorch to work in machine learning?” The answer is no. According to the Turing Institute’s UK ML Industry Survey 2024, 39 % of advertised ML roles focus on strategy, compliance, product or operations rather than writing code. As models move from proof‑of‑concept to production, demand surges for specialists who translate algorithms into business value, manage risk and drive adoption. This guide reveals the fastest‑growing non‑coding ML roles, the transferable skills you may already have, real transition stories and a 90‑day action plan—no gradient descent necessary.

Quantexa Machine‑Learning Jobs in 2025: Your Complete UK Guide to Joining the Decision‑Intelligence Revolution

Money‑laundering rings, sanctioned entities, synthetic identities—complex risks hide in plain sight inside data. Quantexa, a London‑born scale‑up now valued at US $2.2 bn (Series F, August 2024), solves that problem with contextual decision‑intelligence (DI): graph analytics, entity resolution and machine learning stitched into a single platform. Banks, insurers, telecoms and governments from HSBC to HMRC use Quantexa to spot fraud, combat financial crime and optimise customer engagement. With the launch of Quantexa AI Studio in February 2025—bringing generative AI co‑pilots and large‑scale Graph Neural Networks (GNNs) to the platform—the company is hiring at record pace. The Quantexa careers portal lists 450+ open roles worldwide, over 220 in the UK across data science, software engineering, ML Ops and client delivery. Whether you are a graduate data scientist fluent in Python, a Scala veteran who loves Spark or a solutions architect who can turn messy data into knowledge graphs, this guide explains how to land a Quantexa machine‑learning job in 2025.

Machine Learning vs. Deep Learning vs. MLOps Jobs: Which Path Should You Choose?

Machine Learning (ML) continues to transform how businesses operate, from personalised product recommendations to automated fraud detection. As ML adoption accelerates in nearly every industry—finance, healthcare, retail, automotive, and beyond—the demand for professionals with specialised ML skills is surging. Yet as you browse Machine Learning jobs on www.machinelearningjobs.co.uk, you may encounter multiple sub-disciplines, such as Deep Learning and MLOps. Each of these fields offers unique challenges, requires a distinct skill set, and can lead to a rewarding career path. So how do Machine Learning, Deep Learning, and MLOps differ? And which area best aligns with your talents and aspirations? This comprehensive guide will define each field, highlight overlaps and differences, discuss salary ranges and typical responsibilities, and explore real-world examples. By the end, you’ll have a clearer vision of which career track suits you—whether you prefer building foundational ML models, pushing the boundaries of neural network performance, or orchestrating robust ML pipelines at scale.