Senior Data Engineer and Data Manager

Yolk Recruitment Ltd
Cardiff
1 week ago
Create job alert

Role: Senior Data Engineer and Data Manager

Salary: £45,974 to £54,430

Location: Cardiff (hybrid)

The Opportunity

Yolk Recruitment are excited to be working with an innovation-driven civil service organisation as they journey through some incredible projects whilst prioritising forward thinking and excellent digital practices.

Role Overview:

This is chance to work in an organisation that uses data extensively to directly inform its work. As a key part of the data team, you will be supporting the organisation in that evidence based decision-making and working with colleagues who value that contribution. You'll be supported by friendly colleagues from the immediate team as well as other parts of the organisation, but also have the autonomy to make decisions relevant to your role.

Key Responsibilities:

Data Integration & Governance

Lead and manage data integrations between internal systems and third-party services. Serve as the main contact for integration queries across the organization and with external partners. Ensure data flows are consistent, cost-effective, and aligned with system architecture. Work closely with technical and non-technical teams to ensure integration projects account for data governance, quality, and versioning. Document all integrations and maintain up-to-date records.

Data Pipeline Development & Management

Build and maintain data pipelines for ingestion from internal and external sources. Automate data processes to support scalable and efficient operations. Manage and optimize storage structures, enabling simplified data access for analysis. Oversee access controls and data security across the data environment.

Tools & Environment Maintenance

Maintain custom software used within the analytics environment. Uphold data management best practices related to security, storage, and access within a cloud-based setup.

Technologies

At least two years' experience in management and manipulation of both large record level and aggregated datasets, including use of T-SQL Knowledge of Microsoft cloud-based tools automating extract, load and transform of data, including: Azure Data Factory Azure Synapse Link Knowledge of Dynamics 365 and Dynamics F&O including their links to the Microsoft Dataverse and the Power Platform Knowledge of spatial data processing tools, such as QGIS or a variant, and other coding languages, for example Python

Benefits:

31 days annual leave + Bank Holidays, and 2 Privilege days Flexible and hybrid working Generous employer contribution of 28.97% Time off for wellbeing activities Green car scheme Cycle2Work and season travel tickets Access to subsidised sports groups

Think this one's for you

If you think thisSenior Data Engineer and Data Manageropportunity is for you then please apply online.

Yolk Public Sector & Not-for-Profit team works with organisations across the UK to fulfil their recruitment needs and to achieve their D&I objectives. We recruit temporary, contract and permanent hires for 1 off specialist needs or for volume campaigns. We support our applicants to navigate the public sector recruitment processes and secure their dream jobs.

Yolk Recruitment is an equal opportunities employer and embraces diversity in our workforce. We employ the best people for the job at hand and actively encourage applications from all qualified candidates, regardless of gender, age, race, religion, sexual orientation, disability, educational background, parental status, gender identity or any other protected characteristic. We champion and celebrate diversity at Yolk allowing our team to bring their whole selves to work.

Related Jobs

View all jobs

Senior SQL Data Engineer

Senior Data Scientist

Data Engineer Manager

IT Project Manager

Business Intelligence Engineer, EU & EL Books Analytics

Senior Software Engineer - Search Quality (Remote - United Kingdom)

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Contract vs Permanent Machine Learning Jobs: Which Pays Better in 2025?

Machine learning (ML) has swiftly become one of the most transformative forces in the UK technology landscape. From conversational AI and autonomous vehicles to fraud detection and personalised recommendations, ML algorithms are reshaping how organisations operate and how consumers experience products and services. In response, job opportunities in machine learning—including roles in data science, MLOps, natural language processing (NLP), computer vision, and more—have risen dramatically. Yet, as the demand for ML expertise booms, professionals face a pivotal choice about how they want to work. Some choose day‑rate contracting, leveraging short-term projects for potentially higher immediate pay. Others embrace fixed-term contract (FTC) roles for mid-range stability, or permanent positions for comprehensive benefits and a well-defined career path. In this article, we will explore these different employment models, highlighting the pros and cons of each, offering sample take‑home pay scenarios, and providing insights into which path might pay better in 2025. Whether you’re a new graduate with a machine learning degree or an experienced practitioner pivoting into an ML-heavy role, understanding these options is key to making informed career decisions.

Machine‑Learning Jobs for Non‑Technical Professionals: Where Do You Fit In?

The Model Needs More Than Math When ChatGPT went viral and London start‑ups raised seed rounds around “foundation models,” many professionals asked, “Do I need to learn PyTorch to work in machine learning?” The answer is no. According to the Turing Institute’s UK ML Industry Survey 2024, 39 % of advertised ML roles focus on strategy, compliance, product or operations rather than writing code. As models move from proof‑of‑concept to production, demand surges for specialists who translate algorithms into business value, manage risk and drive adoption. This guide reveals the fastest‑growing non‑coding ML roles, the transferable skills you may already have, real transition stories and a 90‑day action plan—no gradient descent necessary.

Quantexa Machine‑Learning Jobs in 2025: Your Complete UK Guide to Joining the Decision‑Intelligence Revolution

Money‑laundering rings, sanctioned entities, synthetic identities—complex risks hide in plain sight inside data. Quantexa, a London‑born scale‑up now valued at US $2.2 bn (Series F, August 2024), solves that problem with contextual decision‑intelligence (DI): graph analytics, entity resolution and machine learning stitched into a single platform. Banks, insurers, telecoms and governments from HSBC to HMRC use Quantexa to spot fraud, combat financial crime and optimise customer engagement. With the launch of Quantexa AI Studio in February 2025—bringing generative AI co‑pilots and large‑scale Graph Neural Networks (GNNs) to the platform—the company is hiring at record pace. The Quantexa careers portal lists 450+ open roles worldwide, over 220 in the UK across data science, software engineering, ML Ops and client delivery. Whether you are a graduate data scientist fluent in Python, a Scala veteran who loves Spark or a solutions architect who can turn messy data into knowledge graphs, this guide explains how to land a Quantexa machine‑learning job in 2025.