Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Head of Data Engineering

The Scottish Government
Edinburgh
1 week ago
Create job alert

Join to apply for the Head of Data Engineering role at The Scottish Government

The Agriculture and Rural Economy (ARE) Directorate of the Scottish Government is part of the DG Net Zero family of Directorates. ARE’s mission is to work together with stakeholders to enable vibrant and thriving communities and businesses, that protect and enhance Scotland’s nature.

ARE relies on digital services to deliver its commitment to support Scotland’s sustainable economic growth in agriculture, the food industry and in rural areas. It does this through direct payments; a broad range of best practice support and education; and ensuring compliance with regulations.

In this newly created role you will build and lead the divisions data engineering function, setting its strategic direction as ARE transitions from a legacy data platform to a new cloud based Unified Data Platform (UDP).

Responsibilities
  • Represent the strategic data engineering perspective in challenging meetings with senior stakeholders, third parties, ministers, and other government department leadership teams.
  • Manage resources to ensure that data services work effectively at an enterprise level.
  • Set up robust governance processes to keep repositories up to date.
  • Establish standards, keep them up to date, and ensure adherence to them.
  • Keep abreast of best practice in industry and across government.
  • Investigate emerging trends in data-related approaches, perform horizon scanning for the organisation, and introduce innovative ways of working.
  • Anticipate problems and know how to prevent them, understanding how they fit into the bigger picture.
  • Build problem-solving capabilities in others and help others identify and describe problems.
Data Engineering & Integration
  • Set direction for teams for approaches and techniques for data profiling.
  • Establish enterprise-scale data integration procedures across the data development life cycle and ensure that teams adhere to them.
  • Leverage the value of enterprise metadata repositories for strategic value.
  • Define the modelling approach for the enterprise.
Technical Standards & Development
  • Set local or team-based standards for programming tools and techniques, selecting appropriate development methods.
  • Advise on the application of standards and methods and ensure compliance.
  • Take technical responsibility for all stages and iterations in a software development project, providing method-specific technical advice and guidance to project stakeholders.
  • Set organisational standards and patterns for others to reuse.
  • Apply knowledge of technical concepts and stay up to date with relevant technologies, concepts, and frameworks.
  • Anticipate, advise, and set strategy for future opportunities.
Testing & Quality Assurance
  • Review requirements and specifications and define test conditions.
  • Identify issues and risks associated with work.
  • Analyse and report test activities and results.
  • Oversee the generation of synthetic test data.
Success Profile

Success profiles are specific to each job, and they include the mix of experience, skills and behaviours candidates will be assessed on.

Experience
  • Lead Criteria 1 – You Own it: You can take technical responsibility for all stages and iterations in a software development project, providing method-specific technical advice and guidance to project stakeholders.
  • Lead Criteria 2 – You Lead it: You have led and set direction for teams for a variety of data engineering approaches and techniques, ensuring successful results and an inclusive team dynamic.
  • Criteria 3 – You Innovate it: You have investigated emerging data trends (including cloud), performed horizon-scanning for the organisation and introduced innovative ways of working, enabling your organisation to maintain a relevant data outlook.
  • Criteria 4 – You Influence it: You have represented the strategic data perspective in challenging meetings such as governance, architecture, executive leadership, and other senior stakeholders, enabling holistic corporate decision-making incorporating data impacts.
Technical Skills

This role is aligned to the Data Engineer – Head of Data Engineering job role within the Data Engineer job family.

Behaviours
  • Leadership (Level 4)
  • Delivering at Pace (Level 4)
How To Apply

Apply online, providing a CV and Supporting Statement (of no more than 750 words) which provides evidence of how you meet each of the 4 Experience criteria listed in the Success Profile above.

Equality Statement

We are committed to equality and inclusion, and we aim to recruit a diverse workforce that reflects the population of our nation.


#J-18808-Ljbffr

Related Jobs

View all jobs

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering

Head of Data Engineering - Analytics & BI

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.

Why the UK Could Be the World’s Next Machine Learning Jobs Hub

Machine learning (ML) is becoming essential to industries across the globe—from finance and healthcare to retail, logistics, defence, and the public sector. Its ability to uncover patterns in data, make predictions, drive automation, and increase operational efficiency has made it one of the most in-demand skill sets in the technology world. In the UK, machine learning roles—from engineers to researchers, product managers to analysts—are increasingly central to innovation. Universities are expanding ML programmes, enterprises are scaling ML deployments, and startups are offering applied ML solutions. All signs point toward a surging need for professionals skilled in modelling, algorithms, data pipelines, and AI systems. This article explores why the United Kingdom is exceptionally well positioned to become a global machine learning jobs hub. It examines the current landscape, strengths, career paths, sector-specific demand, challenges, and what must happen for this vision to become reality.