Senior Data Engineer

The Digital Recruitment Company
London
3 days ago
Create job alert

Senior Data Engineer


Job Type: Permanent

Location:London – Hybrid/flexible

Salary:£55,000 - £70,0000

Consultant:Mags Rendle


Excellent career opportunity!

The Organisation

TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms.

Through their robust infrastructure, cutting edge technology, and exceptional support, they are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do.

The Role

We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth.


You will be responsible for designing, building, and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as we explore future capabilities.


Collaboration is central to the role. You will work within an Agile Scrum environment, using Azure DevOps for backlog management and version control, and contributing to mentorship and knowledge sharing within the team.


This is an opportunity to make a real impact in a small, skilled team, helping shape the firm’s data strategy and capabilities.


Technical Skills

Data Integration & ETL

Azure Data Factory (ADF): Expert in setting up, configuring, and maintaining Azure Data Factory pipelines for efficient ETL processes, with a strong focus on data reliability and performance.

ETL Development:

Skilled in designing and optimising ETL workflows, with knowledge of best practices for data transformation, validation, and loading.


Data Analytics & Machine Learning

Power BI: Proficiency in developing, publishing, and managing Power BI reports and dashboards, with strong data visualisation skills.

SQL & Data Management: Advanced knowledge of SQL for querying, transforming, and managing data, with hands-on experience in SQL Management Studio.

Azure Machine Learning: Some experience desirable in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics.


Data Storage & Processing

Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets.

Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse, with the potential to transition to it for complex data processing needs in the future.


AI Integrations

ChatGPT / Copilot Integrations: Experience integrating with ChatGPT or Microsoft Copilot to automate data processing or enhance analytical insights.

Version Control & Collaboration

Source Control:

Experience with Git or other version control systems, ideally within Azure DevOps for seamless integration with CI/CD.


Azure DevOps Backlog & Agile:

Skilled in working with an Agile Scrum framework, including managing work items in Azure DevOps and completing deliverables within a 2-week sprint cadence.


Soft Skills

Documentation & Knowledge Sharing:

Excellent documentation practices for data pipelines, analytics models, and processes, ensuring knowledge transfer and transparency.

Mentorship & Leadership:

Committed to mentoring junior data engineers, providing guidance on best practices,

technical skills, and professional development.

Problem Solving & Adaptability:

Capable of resolving complex data challenges and adapting solutions to changing business requirements.

Collaboration & Communication:

Strong communication skills for working effectively with cross-functional teams, including data scientists, product teams, and stakeholders.

Benefits

This is an impressive business offering a supportive work environment with opportunities for both personal and professional development.


Some of the benefits:

Holiday Entitlement–25 days rising to 28 over 5 years

Holiday purchase scheme - 5 days and carry over 5 days into the following year

3-4 days over Christmas – offices close

A day to celebrate your birthday, A day to move house, A day for your wedding

A day to make a difference (volunteering day) Give blood (2 hours)

Pension–7% employer / 5% employee contribution

Private Medical Insurance (PMI) –MHD with optical & dental cover(no upper age limit)

Group Income Protection (GIP) –75% of salary (to state pension age)

Death in Service (DIS) –4 x salary (to age 70)

Critical Illness Cover (CIC) -£10k cover (to age 70)

Bonus scheme

Professional qualifications, study, training and development

And many more…..


Get in touch to find out more about the benefit package, the organisation, and this career opportunity.

Apply below And Mags will be in touch to discuss the role further.

The Digital Recruitment Company is an Employment Business for interim, contract and temporary recruitment and acts as an Employment Agency in relation to permanent vacancies.


To apply for this role please contact us at:

Mags Rendle

www.digitalrecruitmentcompany.com

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Databricks

Senior Data Engineer - DV Cleared

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Negotiating Your Machine Learning Job Offer: Equity, Bonuses & Perks Explained

How to Secure a Compensation Package That Matches Your Technical Mastery and Strategic Influence in the UK’s ML Landscape Machine learning (ML) has rapidly shifted from an emerging discipline to a mission-critical function in modern enterprises. From optimising e-commerce recommendations to powering autonomous vehicles and driving innovation in healthcare, ML experts hold the keys to transformative outcomes. As a mid‑senior professional in this field, you’re not only crafting sophisticated algorithms; you’re often guiding strategic decisions about data pipelines, model deployment, and product direction. With such a powerful impact on business results, companies across the UK are going beyond standard salary structures to attract top ML talent. Negotiating a compensation package that truly reflects your value means looking beyond the numbers on your monthly payslip. In addition to a competitive base salary, you could be securing equity, performance-based bonuses, and perks that support your ongoing research, development, and growth. However, many mid‑senior ML professionals leave these additional benefits on the table—either because they’re unsure how to negotiate them or they simply underestimate their long-term worth. This guide explores every critical aspect of negotiating a machine learning job offer. Whether you’re joining an AI-focused start-up or a major tech player expanding its ML capabilities, understanding equity structures, bonus schemes, and strategic perks will help you lock in a package that matches your technical expertise and strategic influence. Let’s dive in.

Machine Learning Jobs in the Public Sector: Opportunities Across GDS, NHS, MOD, and More

Machine learning (ML) has rapidly moved from academic research labs to the heart of industrial and governmental operations. Its ability to uncover patterns, predict outcomes, and automate complex tasks has revolutionised industries ranging from finance to retail. Now, the public sector—encompassing government departments, healthcare systems, and defence agencies—has become an increasingly fertile ground for machine learning jobs. Why? Because government bodies oversee vast datasets, manage critical services for millions of citizens, and must operate efficiently under tight resource constraints. From using ML algorithms to improve patient outcomes in the NHS, to enhancing cybersecurity within the Ministry of Defence (MOD), there’s a growing demand for skilled ML professionals in UK public sector roles. If you’re passionate about harnessing data-driven insights to solve large-scale problems and contribute to societal well-being, machine learning jobs in the public sector offer an unparalleled blend of challenge and impact. In this article, we’ll explore the key reasons behind the public sector’s investment in ML, highlight the leading organisations, outline common job roles, and provide practical guidance on securing a machine learning position that helps shape the future of government services.

Contract vs Permanent Machine Learning Jobs: Which Pays Better in 2025?

Machine learning (ML) has swiftly become one of the most transformative forces in the UK technology landscape. From conversational AI and autonomous vehicles to fraud detection and personalised recommendations, ML algorithms are reshaping how organisations operate and how consumers experience products and services. In response, job opportunities in machine learning—including roles in data science, MLOps, natural language processing (NLP), computer vision, and more—have risen dramatically. Yet, as the demand for ML expertise booms, professionals face a pivotal choice about how they want to work. Some choose day‑rate contracting, leveraging short-term projects for potentially higher immediate pay. Others embrace fixed-term contract (FTC) roles for mid-range stability, or permanent positions for comprehensive benefits and a well-defined career path. In this article, we will explore these different employment models, highlighting the pros and cons of each, offering sample take‑home pay scenarios, and providing insights into which path might pay better in 2025. Whether you’re a new graduate with a machine learning degree or an experienced practitioner pivoting into an ML-heavy role, understanding these options is key to making informed career decisions.