Data Engineer

Chaucer
London
3 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

We are seeking a skilled Data Engineer to join the Data Platform Team, working on the design, build, and optimisation of data pipelines and solutions on our Snowflake-based data platform. This role is critical to delivering robust, scalable, and efficient data solutions that underpin analytics and reporting across the organisation. The Data Engineer will work closely with the Head of Data Platforms and the Data Engineering Lead, contributing to the execution of our data platform strategy and ensuring alignment with architectural standards, governance frameworks, and security requirements. This is a hands‑on engineering role focused on technical delivery rather than line management.


Key Responsibilities

  • Design, develop, and maintain data pipelines and workflows using Snowflake, DBT, and related technologies.
  • Implement efficient data models (star and snowflake schemas) to support analytics and reporting needs.
  • Optimise SQL queries and transformations for performance and cost efficiency.
  • Automate data ingestion and transformation processes to ensure reliability and scalability.
  • Integrate Snowflake with upstream and downstream systems, including Azure services, legacy systems, and external data sources.
  • Collaborate with architects and engineering leads to ensure solutions align with enterprise architecture and security standards.
  • Contribute to the adoption of modern frameworks (e.g., FiveTran, ADF) to enhance platform capabilities.
  • Apply engineering best practices for coding, testing, and deployment, including CI/CD and automated testing.
  • Ensure data quality through validation, monitoring, and error‑handling mechanisms.
  • Contribute to reusable patterns and frameworks for data engineering tasks.
  • Work closely with the Head of Data Platforms, Data Engineering Lead, architects, and delivery teams to translate requirements into technical solutions.
  • Troubleshoot and resolve data pipeline issues, providing timely support to stakeholders.
  • Participate in code reviews and knowledge‑sharing sessions within the team.
  • Implement and adhere to standards for data security, access control, and metadata management.
  • Ensure compliance with internal policies and external regulations such as GDPR.
  • Support data governance initiatives, including data lineage and quality frameworks.
  • Maintain clear documentation for data pipelines, processes, and engineering standards.
  • Support onboarding and enablement activities for new team members.
  • Snowflake Expertise – Proven experience in developing, optimising, and tuning Snowflake solutions for performance and cost efficiency.
  • Data Engineering Proficiency – Advanced skills in SQL, DBT, and data modelling (including star and snowflake schemas) to deliver scalable, high‑quality solutions.
  • Cloud Integration – Familiarity with Azure services and modern data engineering tools for seamless integration across platforms.
  • Governance & Compliance Awareness – Strong understanding of data governance, security, and regulatory requirements (e.g., GDPR).
  • Collaboration & Communication – Ability to work effectively in a fast‑paced environment and communicate complex technical concepts to both technical and non‑technical stakeholders.
  • Automation & DevOps Practices – Hands‑on experience with CI/CD pipelines, automated testing, and engineering best practices.
  • Domain Knowledge – Exposure to insurance or financial services data domains (desirable).
  • Problem‑Solving & Innovation – Strong analytical skills with a proactive approach to continuous improvement and innovation.
  • Technical Curiosity – Ability to stay current with emerging technologies and contribute to the evolution of the data platform.
  • Technical Requirements – Bachelor’s degree; industry certifications in business/data analysis or insurance domain desirable.

About the Company

Chaucer is a leading insurance group at Lloyd’s, the world's specialist insurance market. We help protect industries around the world from the risks they face. Our customers include major airlines, energy companies, shipping groups, global manufacturers and property groups. Our headquarters are in London, and we have international offices in Bermuda, Copenhagen, Dubai and Singapore to be closer to our clients across the world. To learn more about us please visit our website. Chaucer is committed to diversity, actively values difference and respects people regardless of the protected characteristics which are outlined in the Equality Act 2010 (UK legislation) as a result of the Equal Treatment Directive 2006 (EU legislation). A diverse workforce and an inclusive workplace are core to our success as a business and integral to our winning strategy and culture. We recruit from the widest available pool of talent, and our hiring, assessment and selection process is fair, free from bias and one which ensures we select the right person for the job, based on merit. We are committed to promoting a culture that actively values difference, and recognises that everyone has the right to be treated with dignity and respect throughout their employment. We are open to considering flexible working arrangements for all roles and encourage you to outline your needs during the interview process.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.