Data Engineer

Data Engineer

Azure | Databricks | PySpark | Hybrid Cloud | Fabric

Location:London (Hybrid)
Salary:£85,000 + Bonus + Benefits
Type:Permanent

A Data Engineeris required for a fast-evolving (re)insurance business at the heart of the Lloyd's market, currently undergoing a major data transformation. With a strong foundation in the industry and a clear vision for the future, they're investing heavily in their data capabilities to build a best-in-class platform that supports smarter, faster decision-making across the business.

As part of this journey, they're looking for aData Engineerto join their growing team. This is a hands-on role focused on building scalable data pipelines and enhancing a modern Lakehouse architecture usingDatabricks,PySpark, andAzure. The environment is currentlyhybrid cloud and on-prem, with a strategic move towardsMicrosoft Fabric-so experience across both is highly valued.

What you'll be doing:

• Building and maintaining robust data pipelines usingDatabricks,PySpark, andAzure Data Factory.
• Enhance and maintain a Lakehouse architecture using Medallion principles
• Working across bothcloud and on-prem environments, supporting the transition toMicrosoft Fabric.
• Collaborating with stakeholders across Underwriting, Actuarial, and Finance to deliver high-impact data solutions.
• Support DevOps practices and CI/CD workflows in Azure

Technical Requirements:

• Strong hands-on experience with:
  • Databricks(including pipeline development and orchestration)
  • PySparkandPythonfor data transformation and processing
  • Azure Data Factoryfor data integration
• Solid understanding of:
  • Medallion architectureand Lakehouse design principles
  • Hybrid cloud/on-prem environments
  • Microsoft Azureecosystem
• Exposure to or interest in:
  • Microsoft Fabricand its evolving role in enterprise data platforms
  • Azure DevOpsfor CI/CD and deployment
  • T-SQLand dimensional modelling (Kimball methodology)
  • Experience inFinancial ServicesorLloyd's marketis a plus

Apply now or get in touch to find out more -