Lead Data Engineer

DWP Digital
Manchester
2 days ago
Create job alert

Pay up to £89,995, plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. As a Lead Data Engineer, you will be leading our data engineering delivery, joining our Data & Analytics hub or Health domain spoke. You will lead in the design, building and testing for data services, providing technical direction that ensures we provide reliable, trusted and interoperable data to meet user needs across DWP, other government departments and with our private sector partners. You will ensure that our data products are built using the right techniques in how we prepare, store and use data. You will also be responsible for collating the technical requirements necessary to be implemented as migration to new platforms are rolled out. You will work alongside data engineers, responsible for the enhancing the capability within the team. You will also work alongside data scientists, digital performance analysts, testers, content designers, user researchers, and Power BI specialists. DWP. Digital with Purpose. We are looking for a Lead Data Engineer to join our community of tech experts in DWP Digital. We're using fresh ideas and leading-edge tech to build and maintain digital solutions that will be used by nearly every person in the UK, every day and at key moments in their lives. DWP have big ambitions to become a data driven organisation through delivery of our data strategy. These are key roles leading our data engineering delivery in our Data & Analytic hub Data Platform Team, and, within our Health domain data team. DWP is the UK's largest government department. We help people into work, and make payments worth over £195bn a year to support and empower millions of people. The scale of what we do is extraordinary, and our purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? How will this be assessed? Our application process includes both a technical statement and a personal statement. This is your opportunity to showcase clear examples and evidence of how you meet the following: Technical Statement: Give an example of when you have provided the vision and strategic direction for data engineering, ensuring initiatives are aligned to organisation strategy and objectives. Personal statements: Provides the vision and strategic direction for data engineering, ensuring initiatives are aligned to organisation strategy and objectives. Ability and experience of predicting and advising on future technology changes that present opportunities for improvement of DWP platform and tooling tech portfolio. Experience leading teams though large-scale data and platform transformation programmes, ensuring best practice and building capability whilst maximising the functionality of incoming technology. Experience of delivering migration to modern data platforms including Data Warehouse, Lakehouse, and implementing cross-government/industry Hub and Spoke architecture patterns. Experience and detailed understanding of AWS and/or Azure data provision through a loosely coupled cloud stack including Data Integration (ETL/ELT) eg Spark and/or Informatica, Data Quality, Data Catalogue, data storage to provide multi-cloud analytical and insight data for our critical data analyst and data science community. Detailed knowledge of establishing engineering standards across multiple platforms and native toolsets. Experience of implementing these standards across platforms and leading technical teams in keeping those standards up to date and ensuring adherence to them. Experience of leading and mediating between key stakeholders and developing relationships; communicating with stakeholders at all levels and cross government. Includes manage stakeholders' expectations and facilitating discussions across high risk and complexity or under constrained timescales. The sift panel will use the information you provide to assess your experience, skills and knowledge against the above. Full details, as well as application guidance are detailed in the Civil Service Job description - Click 'Apply' to be redirected here. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds, Manchester, or Newcastle whichever is most convenient for you. Hybrid Working: We work a hybrid model - you'll spend some time working at home and some time collaborating face to face in a hub. Pay: We offer competitive pay of up to £89.995. Pension: You'll get a brilliant civil service pension with employer contributions worth 28.97%. Holidays: A generous leave package starting at 26 days rising to 31 days over time. You can also take up to 3 extra days off a month on flexi-time. You'll also get all the usual public holidays. We have a broad benefits package built around your work-life balance which includes: An award-winning environment and culture: Employer of the Year 2023 (Women In IT Awards), Founders Award for Outstanding Digital Leadership 2023 (Digital 100) Flexible working including flexible hours and flex-friendly policies Time off volunteering and charitable giving Bring your authentic self to work with 'I Can Be Me in DWP' Discounts and savings on shopping, fun days out and more Interest-free loans to buy a bike or a season ticket, so it's even easier for you to get to work and start making a difference Sports and social activities Professional development, coaching, mentoring and career progression opportunities. Process: We know your time is valuable so our application and selection process is just two stages: Apply: complete your application on Civil Service Jobs. There'll be full instructions when you click through. Interview: a single stage interview online. CLICK APPLY for more information and to start your application. ADZN1_UKTJ

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Databricks

Lead/Senior Data Engineer

Lead Data Engineer - Multi-Strat Fund - Research Platform - £300k

Lead Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Best UK Universities for Machine Learning Degrees (2025 Guide)

Explore ten UK universities that deliver world-class machine-learning degrees in 2025. Compare entry requirements, course content, research strength and industry links to find the programme that fits your goals. Machine learning (ML) has shifted from academic curiosity to the engine powering everything from personalised medicine to autonomous vehicles. UK universities have long been pioneers in the field, and their programmes now blend rigorous theory with hands-on practice on industrial-scale datasets. Below, we highlight ten institutions whose undergraduate or postgraduate pathways focus squarely on machine learning. League tables move each year, but these universities consistently excel in teaching, research and collaboration with industry.

How to Write a Winning Cover Letter for Machine Learning Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for machine learning jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the machine learning sector. When applying for a machine learning job, your cover letter is a vital part of your application. Machine learning is an exciting and rapidly evolving field, and your cover letter offers the chance to demonstrate your technical expertise, passion for AI, and your ability to apply machine learning techniques to solve real-world problems. Writing a cover letter for machine learning roles may feel intimidating, but by following a clear structure, you can showcase your strengths effectively. Whether you're just entering the field, transitioning from another role, or looking to advance your career in machine learning, this article will guide you through a proven four-paragraph structure. We’ll provide practical tips and sample lines to help you create a compelling cover letter that catches the attention of hiring managers in the machine learning job market.

Veterans in Machine Learning: A Military‑to‑Civilian Pathway into AI Careers

Introduction Artificial intelligence is no longer relegated to sci‑fi films—it underpins battlefield decision‑support, fraud detection, and even supermarket logistics. The UK Government’s 2025 AI Sector Deal forecasts an additional £200 billion in GDP by 2030, with machine‑learning (ML) engineers cited as the nation’s second most in‑demand tech role (Tech Nation 2024). The Ministry of Defence’s Defence AI Strategy echoes that urgency, earmarking £1.6 billion for FY 2025–28 to embed ML into planning, logistics, and autonomous systems. If you have ever tuned a radar filter, plotted artillery trajectories, or sifted sensor data for actionable intel, you have already worked with statistical modelling—the backbone of machine learning. This guide shows UK veterans how to reframe military experience for ML roles, leverage MoD transition funding, and land high‑impact positions building the models shaping tomorrow’s defence and commercial landscapes. Quick Win: Bookmark our live board for Machine‑Learning Engineer roles to see who’s hiring today.