Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer

John Goddard Associates
City of London
2 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer | Cambridge | Greenfield Project

Senior Data Engineer - 12 month FTC

Join to apply for the Senior Data Engineer role at John Goddard Associates

2 days ago Be among the first 25 applicants

Join to apply for the Senior Data Engineer role at John Goddard Associates

Get AI-powered advice on this job and more exclusive features.

Up to £95,000 + benefits | Hybrid (3 days a week in City of London)

A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team.

You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements.

This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability.

Key Responsibilities

  • Design and build robust ETL pipelines using Python and AWS services
  • Own and maintain Airflow workflows
  • Ensure high data quality through rigorous testing and validation
  • Analyse and understand complex data sets before pipeline design
  • Collaborate with stakeholders to translate business requirements into data solutions
  • Monitor and improve pipeline performance and reliability
  • Maintain documentation of systems, workflows, and configs

Tech environment

  • Python, SQL/PLSQL (MS SQL + Oracle), PySpark
  • Apache Airflow (MWAA), AWS Glue, Athena
  • AWS services (CDK, S3, data lake architectures)
  • Git, JIRA

You Should Apply If You Have

  • Strong Python and SQL skills
  • Proven experience designing data pipelines in cloud environments
  • Hands-on experience with Airflow (ideally MWAA)
  • Background working with large, complex datasets
  • Experience in finance or similar high-volume, regulated industries (preferred but not essential)
  • High attention to detail and a clear commitment to data quality

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

LNKD1_UKTJSeniority level

  • Seniority levelMid-Senior level

Employment type

  • Employment typeFull-time

Job function

  • Job functionInformation Technology
  • IndustriesData Infrastructure and Analytics

Referrals increase your chances of interviewing at John Goddard Associates by 2x

Get notified about new Senior Data Engineer jobs in City Of London, England, United Kingdom.

London, England, United Kingdom 1 day ago

Senior Data Analyst, Reporting & Operations

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

Slough, England, United Kingdom 4 days ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 19 hours ago

Senior Data Analysts and Full Stack DevelopersData Architect - 18 month FTC London/Hybrid - Up to £74kSenior Consulting Analyst - Private Equity Data & TechnologySenior Data Analyst, Reporting & Operations

London, England, United Kingdom 2 weeks ago

EMEA Senior Data Centre Systems Design Engineer

Slough, England, United Kingdom 2 weeks ago

London, England, United Kingdom 21 hours ago

London, England, United Kingdom 2 weeks ago

Data Architect – Clinical Knowledge Graph

London, England, United Kingdom 3 weeks ago

Contract Data Architect (Modelling) - FS - London (Hybrid) - £600pd Outside IR35

London, England, United Kingdom 4 weeks ago

Principal Solution Engineer – AI and Data Use Governance

London, England, United Kingdom 2 weeks ago

Senior Lead Software Engineer - Team Lead - Accelerator Business

London, England, United Kingdom 6 days ago

London, England, United Kingdom 2 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.

Why the UK Could Be the World’s Next Machine Learning Jobs Hub

Machine learning (ML) is becoming essential to industries across the globe—from finance and healthcare to retail, logistics, defence, and the public sector. Its ability to uncover patterns in data, make predictions, drive automation, and increase operational efficiency has made it one of the most in-demand skill sets in the technology world. In the UK, machine learning roles—from engineers to researchers, product managers to analysts—are increasingly central to innovation. Universities are expanding ML programmes, enterprises are scaling ML deployments, and startups are offering applied ML solutions. All signs point toward a surging need for professionals skilled in modelling, algorithms, data pipelines, and AI systems. This article explores why the United Kingdom is exceptionally well positioned to become a global machine learning jobs hub. It examines the current landscape, strengths, career paths, sector-specific demand, challenges, and what must happen for this vision to become reality.