Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer x2

UK Export Finance
Leeds
1 day ago
Create job alert
Overview

The Digital, Data and Technology (DDAT) directorate has recently been established in UKEF, bringing together the digital expertise within the organisation to provide representation of digital services, user centred design, analytics and technology at the highest levels. UKEF is committed to being a more customer-centric organisation, making it easier for customers to engage with us through improved response times, quicker decision-making, and streamlined case-processing. To support this, UKEF is embracing digital as the primary channel for managing relationships with a broader range of stakeholders. Focused on delivering end-to-end services that meet user needs and enable business outcomes, this is an exciting new role that reflects the growth and ambition of UKEF's digital strategy.


Role emphasis

This role requires hands-on experience with Informatica to develop and maintain data integration solutions, as well as proficiency in Azure cloud services to build scalable and secure data platforms. You will identify opportunities to improve data infrastructure and processes, manage ETL workflows, and oversee the deployment and release of data pipelines and applications.


Main Activities

  • Design, build, and maintain scalable data integration pipelines using tools such as Informatica, ensuring efficient ingestion, transformation, and delivery of structured and unstructured data.
  • Develop and manage cloud-based data solutions leveraging Azure services including Azure Data Lake, Azure SQL, and Azure Managed Instance, with a focus on performance, security, and cost-efficiency.
  • Leverage Microsoft Fabric's unified data platform to support end-to-end workflows - from ingestion and transformation to analytics and visualization - integrating services like OneLake, Data Factory, and Synapse.
  • Monitor and troubleshoot data processing systems to ensure high availability, reliability, and timely resolution of issues across production and development environments.
  • Ensure data governance and compliance with regulations such as GDPR, through implementation of access controls, encryption, and data masking strategies.
  • Collaborate with stakeholders to identify opportunities for improving data infrastructure, automation, and analytics capabilities.
  • Lead code reviews and quality assurance efforts to uphold engineering best practices and maintain high standards across the data engineering team.
  • Manage deployment and release processes for data pipelines and applications, ensuring robust versioning, rollback strategies, and change control.
  • Contribute to the organisation's data strategy and roadmap, staying current with industry trends and emerging technologies in data engineering and cloud computing.

Role alignment and responsibilities

This role is aligned with the Government Digital and Data Profession Capability Framework - Senior Data Engineer. This list is not exhaustive, and you may be required to carry out additional duties according to business needs.


Additional responsibilities

  • Communicating between the technical and non-technical (A, I)

    • You can communicate effectively with technical and non-technical stakeholders.
    • You can support and host discussions within a multidisciplinary team, with potentially difficult dynamics.
    • You can be an advocate for the team externally and can manage differing perspectives.


  • Data analysis and synthesis (A, I)

    • You can undertake data profiling and source system analysis.
    • You can present clear insights to colleagues to support the end use of the data.


  • Data development process (A, I)

    • You can design, build and test data products that are complex or large scale.
    • You can build teams to complete data integration services.


  • Data innovation (A, I)

    • You can understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage


  • Data integration design (A, I)

    • You can understand the concepts and principles of data modelling.
    • You can produce relevant data models across multiple subject areas.
    • You can reverse-engineer data models from a live system.
    • You can understand industry-recognised data modelling patterns and standards, and when to apply them.
    • You can compare and align different data models.


  • Data modelling (A, I)

    • You can understand the concepts and principles of data modelling and can produce relevant data models.
    • You can work across government and industry, recognising opportunities for the reuse and alignment of data models in different organisations.
    • You can design the method to categorise data models within an organisation.


  • Metadata management (A, I)

    • You can design an appropriate metadata repository and present changes to existing metadata repositories.
    • You can understand a range of tools for storing and working with metadata.
    • You can provide oversight and advice to more inexperienced members of the team.


  • Problem resolution (A, I)

    • You can respond to problems in databases, data processes, data products and services as they occur.
    • You can initiate actions, monitor services and identify trends to resolve problems.
    • You can determine the appropriate remedy and assist with its implementation, and with preventative measures.


  • Programming and build (A, I)

    • You can use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations.
    • You can collaborate with others to review specifications where appropriate.


  • Technical understanding (A, I)

    • You can understand the core technical concepts related to the role and apply them with guidance.



Selection process and qualifications

We will assess you against these behaviours during the selection process:
Changing and Improving, Delivering at Pace, Communicating and Influencing.


Technical skills will be assessed during the selection process:
Please provide examples of data engineering solutions using Microsoft Fabric and/or Informatica IICS, and describe SQL/data warehouse experience. See further details in the application materials.


Application guidance and eligibility

This vacancy uses Success Profiles and will assess your Behaviours, Experience and Technical skills. The application must be completed by 23:55 on the day of the closing date. The role requires eligibility checks and potential security clearances as detailed in the vetting charter and baseline personnel security standard requirements.


Benefits and terms

Alongside a salary of £56,475, UK Export Finance contributes £16,360 towards the Civil Service Defined Benefit Pension scheme. Benefits include learning and development tailored to your role, flexible working options, an inclusive culture, and a Civil Service pension with employer contributions of 28.97%.


National and Civil Service context

The Civil Service Code sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition, and we promote equality and inclusion. The Civil Service also offers schemes to support candidates with disabilities and to assist with redeployment where appropriate.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer | Cambridge | Greenfield Project

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.

Why the UK Could Be the World’s Next Machine Learning Jobs Hub

Machine learning (ML) is becoming essential to industries across the globe—from finance and healthcare to retail, logistics, defence, and the public sector. Its ability to uncover patterns in data, make predictions, drive automation, and increase operational efficiency has made it one of the most in-demand skill sets in the technology world. In the UK, machine learning roles—from engineers to researchers, product managers to analysts—are increasingly central to innovation. Universities are expanding ML programmes, enterprises are scaling ML deployments, and startups are offering applied ML solutions. All signs point toward a surging need for professionals skilled in modelling, algorithms, data pipelines, and AI systems. This article explores why the United Kingdom is exceptionally well positioned to become a global machine learning jobs hub. It examines the current landscape, strengths, career paths, sector-specific demand, challenges, and what must happen for this vision to become reality.