Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Lead Data Engineer

Waracle
Glasgow
3 days ago
Create job alert
Lead Data Engineer

Waracle are looking for a Lead Data Engineer for an exciting new role joining our world-class digital technology consultancy and home to a diverse, smart, curious and ambitious community of specialists in technology-driven transformation.


We work with ambitious clients to help them solve their biggest business and customer challenges. We help our clients to innovate and create intelligent digital products and services. We thrive on complex challenges and deliver business-critical IT transformation projects, moving seamlessly from strategy, design and delivery to operations.


This is a Hybrid role working from any of our offices (Glasgow, London, Edinburgh or Dundee) 2 days a week.


Key responsibilities

  • Owning and directing technical delivery for large-scale data projects, maintaining accountability for technical outcomes, solution quality, and proactively making tradeoffs on scope or resources to maintain delivery pace.
  • Defining technical strategy by translating client priorities into actionable plans, and ensuring team delivery consistently aligns with business objectives.
  • Designing robust data systems while effectively balancing performance, cost, and security requirements.
  • Driving best practices by shaping CI/CD and IaC practices across multiple teams, and defining coding, testing, and review standards across the Data & AI practice.
  • Resolving complex challenges including sophisticated integration issues across cloud and on-prem systems, and leading root cause analysis and systemic fixes for major incidents.
  • Partnering and aligning stakeholders by working with Product/Delivery to align technical decisions with client outcomes, managing expectations on scope and budget, and de-escalating conflicts.
  • Leading project execution by facilitating backlog refinement and workshops, guiding the team in tracking delivery metrics (e.g., DORA), and ensuring clear, up-to-date technical documentation is created.
  • Leading and coaching the team by ensuring a collaborative, psychologically safe environment, coaching team members regularly, and formally/informally mentoring others in the practice.
  • Upholding Waracle’s values on client engagements and driving cross-project improvements in delivery tooling.

What you'll bring

  • Proven track record of designing, implementing, and optimising complex, large-scale data pipelines and cloud infrastructure
  • Deep expertise in at least one major cloud platform (AWS, Azure, or GCP), with working knowledge of a second platform preferred
  • Advanced programming skills in Python and SQL, with experience in Scala or Java
  • Expert-level knowledge of Infrastructure as Code tooling (Terraform, CloudFormation, ARM templates)
  • Comprehensive experience with data processing frameworks (Apache Spark, dbt) and orchestration tools (Apache Airflow, Step Functions)
  • Strong command of CI/CD tools and methodologies (GitHub Actions, Azure Pipelines, Cloud Build)
  • Demonstrable expertise in system design, technical planning, and architectural guidance for distributed data systems
  • Exceptional client-facing and consulting abilities, with strong presentation, stakeholder management, and mentoring skills
  • Strong understanding and practical application of Agile methodologies (Scrum, Kanban)

Benefits

  • Rest & Recharge: 27 days annual leave plus 8 bank holidays, totaling 35 days of holiday.
  • Financial Future & Security: 5% pension contribution, Death in Service benefit – 2 x annual salary.
  • Health & Wellness: Medicash Health Cash Plans, Employee Assistance Programme, Group Sickness Cover.
  • Flexible Working: Hybrid working, home office setup budget.
  • Learning & Development: Udemy Business, dedicated learning budget.
  • Lifestyle Perks: Cycle to Work Scheme, exclusive gym and retail discounts.
  • Family First: Enhanced parental leave, fertility journey support.
  • Community & Connection: Regular meet‑ups, Spirit of Waracle charitable involvement.

We are an equal opportunities employer and welcome applications from all suitably qualified persons regardless of their race, gender, disability, religion/belief, sexual orientation or age.


#J-18808-Ljbffr

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Reigate

Lead Data Engineer

Lead Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.