Senior Engineer, Data Engineering

Senior Data Engineer
Job Type : Permanent
Location: London – Hybrid/flexible
Excellent career opportunity!

TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms.
Through their robust infrastructure, cutting edge technology, and exceptional support, they are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do.

We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth.

You will be responsible for designing, building, and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. You will work within an Agile Scrum environment, using Azure DevOps for backlog management and version control, and contributing to mentorship and knowledge sharing within the team.

This is an opportunity to make a real impact in a small, skilled team, helping shape the firm’s data strategy and capabilities.

Data Integration & ETL
Azure Data Factory (ADF): Expert in setting up, configuring, and maintaining Azure Data Factory pipelines for efficient ETL processes, with a strong focus on data reliability and performance.
Skilled in designing and optimising ETL workflows, with knowledge of best practices for data transformation, validation, and loading.

Data Analytics & Machine Learning
Power BI: Proficiency in developing, publishing, and managing Power BI reports and dashboards, with strong data visualisation skills.
SQL & Data Management: Advanced knowledge of SQL for querying, transforming, and managing data, with hands-on experience in SQL Management Studio.
Azure Machine Learning: Some experience desirable in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics.

Data Storage & Processing
Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets.
Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse, with the potential to transition to it for complex data processing needs in the future.

AI Integrations
Experience integrating with ChatGPT or Microsoft Copilot to automate data processing or enhance analytical insights.

Experience with Git or other version control systems, ideally within Azure DevOps for seamless integration with CI/CD.

Azure DevOps Backlog & Agile:
Skilled in working with an Agile Scrum framework, including managing work items in Azure DevOps and completing deliverables within a 2-week sprint cadence.

Excellent documentation practices for data pipelines, analytics models, and processes, ensuring knowledge transfer and transparency.
Committed to mentoring junior data engineers, providing guidance on best practices,
technical skills, and professional development.
Capable of resolving complex data challenges and adapting solutions to changing business requirements.
Strong communication skills for working effectively with cross-functional teams, including data scientists, product teams, and stakeholders.

This is an impressive business offering a supportive work environment with opportunities for both personal and professional development.

Holiday Entitlement–25 days rising to 28 over 5 years
Holiday purchase scheme - 5 days and carry over 5 days into the following year
3-4 days over Christmas – offices close
Pension–7% employer / 5% employee contribution
Private Medical Insurance (PMI) –MHD with optical & dental cover(no upper age limit)
Group Income Protection (GIP) –75% of salary (to state pension age)
Critical Illness Cover (CIC) -£10k cover (to age 70)
Bonus scheme
Professional qualifications, study, training and development
Get in touch to find out more about the benefit package, the organisation, and this career opportunity.
The Digital Recruitment Company is an Employment Business for interim, contract and temporary recruitment and acts as an Employment Agency in relation to permanent vacancies.