Lead Data Engineer

Aviva
York
1 month ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer (AD -Consulting) - Exclusive

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Hybrid working

Lead Data Engineer

Salary £50,000 - £65,000

Are you someone who is passionate about the power of data, recognises its value, and loves working with a broad range of stakeholders and teams? If so, this could be a great opportunity for you.

The insurance industry is evolving rapidly with technological advancements, and Aviva is investing in creating data products that drive machine learning and analytics as a distinctive capability.

Quantum is dedicated to collaboration, sharing expertise and ideas, and fostering continuous learning from our data professionals. Coming together as one allows us to share data techniques more easily, rapidly re-use best practice ideas, and support your learning and development. This year we were shortlisted for five categories at the prestigious Data IQ 2024 Awards, recognising Aviva’s unwavering commitment to innovation and excellence in the field of Data and AI.

A bit about the job:

The role involves collaborating with senior data and business leaders, engineers, data & platform architects, and business/data teams to deliver solutions that empower our data teams to transform our data capability. You will be responsible for owning and delivering the Data Engineering pipelines that power our Analytics. Working across a broad range of initiatives in both BAU and our transformation portfolio, you will formulate and deliver against a data roadmap, balancing tactical and strategic needs to move towards a purposeful set of data products to support the business.

We are looking for someone who can challenge the status quo, focus on delivering great business outcomes, and champion the use of data, technology, and collaboration to help us shape an exciting future.

Come and join our high-profile Data Engineering Team as a Data Engineering Specialist and be part of an innovative team that transforms raw data into valuable business insights.

Are you ready to join us in our quest to drive innovation and harness the power of data and AI across Aviva? Quantum is Aviva's Global Data Community, with us, you will have access to data for over 19 million customers, allowing you to create truly outstanding products and deliver enhanced experiences for our customers. This year we were shortlisted for five categories at the prestigious Data IQ 2024 Awards, recognising Aviva’s unwavering commitment to innovation and excellence in the field of Data and AI.

What You'll Do:

Design, Build, and Deliver Data Products: Interpret business problems and create and maintain reusable data products that are trusted and maintained.

Collaborate Across Teams: Share knowledge, provide the data and support needed to solve business problems.

Communicate Effectively: Explain data issues and solutions to non-data stakeholders.

Maintain Data Environments: Oversee regular processes and ensure adherence to data governance.

Mentor and Lead Others: Guide other data engineers, review code, and reduce risk to data quality and delivery.

Skills and Experience:

SQL and Database Management: Strong experience with Snowflake and SQL Server or similar.

ETL/ELT Development: Experience with dbt (core or cloud) using SQL and Python and/or similar technology such as MS SQL SSIS, Azure Data Factory, DataIku, or Informatica.

CI/CD Processes: Knowledge of Azure DevOps and how to use it to support a CI/CD process for data.

Data Modelling: Understanding of Analytical Data Modelling techniques like Dimensional Modelling and Data Vault Modelling.

What you’ll get for this role:

Our purpose - with you today, for a better tomorrow – is a promise we make to our colleagues too. And one of the ways we live up to that promise is by investing in you. We have so much to offer when it comes to being an Aviva colleague.

Startingsalarybetween £50,000 - £65,000 (depending on location, skills, experience, and qualifications)

Bonus opportunity - 10% of annual salary - Actual amount depends on your performance and Aviva’s

Generouspensionscheme - Aviva will contribute up to 14%, depending on what you put in.

29 daysholidayplus bank holidays, and you can choose to buy or sell up to 5 days

Make your money go further - Up to 40%discount on Aviva products, and other retailer discounts

Up to £1,200 of free Aviva shares per year through ourMatching Share Planand share in the success of Aviva with ourSave As You Earnscheme

Brilliantlysupportive policiesincluding parental and carer’s leave

Flexible benefitsto suit you, includingsustainability optionssuch as cycle to work

Make a difference, be part of ourAviva Communitiesand use your 3paid volunteering days to help others

We take yourwellbeingseriously with lots of support and tools

Take a look to learn more. Put a salary into this calculator to see what your total Aviva Reward could be.

Aviva is for everyone:

We’re inclusive and welcome everyone – we want applications from all backgrounds and experiences. Excited but not sure you tick every box? Even if you don’t, we would still encourage you to apply. We also consider all forms of flexible working, including part time and job shares.

We flex locations, hours and working patterns to suit our customers, business, and you. Most of our people are smart working – spending around 50% of their time in our offices every week - combining the benefits of flexibility, with time together with colleagues.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Quantum-Enhanced Machine Learning—Propelling AI into the Next Frontier

Machine learning (ML) has revolutionised how we interpret data, build predictive models, and create intelligent applications. From recommendation engines and self-driving cars to advanced genomics and natural language processing, ML solutions are integral to nearly every corner of modern life. However, as data complexity and model size continue to skyrocket, the computational demands placed on ML systems grow in tandem—often pushing even high-performance classical computers to their limits. In recent years, quantum computing has emerged as a tantalising solution to these challenges. Unlike traditional digital systems, quantum computers exploit quantum mechanics—superposition and entanglement—to process information in ways that defy conventional logic. As these machines mature, they promise exponential speed-ups for certain tasks, potentially reshaping how we approach AI and data-intensive challenges. What does this mean for machine learning? Enter quantum-enhanced ML, a new frontier where quantum processors and classical ML frameworks unite to accelerate model training, tackle high-dimensional data, and solve complex optimisation tasks more efficiently. In this article, we will: Unpack the current state of machine learning, highlighting key bottlenecks. Provide a concise overview of quantum computing—why it’s radical and how it differs from classical technology. Examine potential breakthroughs in quantum-enhanced ML, including real-world use cases and technical approaches. Explore the roles and skill sets that will define this quantum-AI era, with guidance on how to prepare. Discuss the roadblocks (like hardware maturity and ethical concerns) and how they might be addressed in the years to come. If you’re a machine learning engineer, data scientist, or simply an AI enthusiast fascinated by the next wave of computational innovation, read on—quantum computing could become an integral part of your future toolkit, opening up job opportunities and reimagining what ML can achieve.

Machine Learning Jobs at Newly Funded UK Start-ups: Q3 2025 Investment Tracker

Machine learning (ML) has become the beating heart of modern tech innovation, powering breakthroughs in healthcare, finance, cybersecurity, robotics, and more. Across the United Kingdom, this surge in ML-driven solutions is fueling the success of countless start-ups—and spurring demand for talented machine learning engineers, data scientists, and related professionals. If you’re eager to join a high-growth ML company or simply want to keep tabs on the latest trends, this Q3 2025 Investment Tracker will guide you through the newly funded UK start-ups pushing the boundaries of ML. In this article, we’ll highlight key developments from Q3 2025, delve into the most promising newly funded ventures, and shed light on the machine learning roles they’re urgently seeking to fill. Plus, we’ll show you how to connect with these employers via MachineLearningJobs.co.uk, a dedicated platform for ML job seekers. Let’s dive in!

Portfolio Projects That Get You Hired for Machine Learning Jobs (With Real GitHub Examples)

In today’s data-driven landscape, the field of machine learning (ML) is one of the most sought-after career paths. From startups to multinational enterprises, organisations are on the lookout for professionals who can develop and deploy ML models that drive impactful decisions. Whether you’re an aspiring data scientist, a seasoned researcher, or a machine learning engineer, one element can truly make your CV shine: a compelling portfolio. While your CV and cover letter detail your educational background and professional experiences, a portfolio reveals your practical know-how. The code you share, the projects you build, and your problem-solving process all help prospective employers ascertain if you’re the right fit for their team. But what kinds of portfolio projects stand out, and how can you showcase them effectively? This article provides the answers. We’ll look at: Why a machine learning portfolio is critical for impressing recruiters. How to select appropriate ML projects for your target roles. Inspirational GitHub examples that exemplify strong project structure and presentation. Tangible project ideas you can start immediately, from predictive modelling to computer vision. Best practices for showcasing your work on GitHub, personal websites, and beyond. Finally, we’ll share how you can leverage these projects to unlock opportunities—plus a handy link to upload your CV on Machine Learning Jobs when you’re ready to apply. Get ready to build a portfolio that underscores your skill set and positions you for the ML role you’ve been dreaming of!