National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Principle Data Engineer ( AWS & Airflow )

London
1 day ago
Create job alert

Job Title: Principal Data Engineer

Location: London, UK - Hybrid (Liverpool Street office)

Department: Data & Engineering

Reports To: Head of Data Science

Employment Type: Permanent

A leading global payments and fintech platform, empowering clients to innovate and scale. Their mission is to create frictionless, secure, and intelligent payment solutions that unlock value across banking, financial services, and digital assets.

As they continue to scale their data infrastructure, they're seeking a seasoned Principal Data Engineer to help design, build, and optimise a modern data platform, with a focus on orchestration (Airflow), scalable data warehouse architecture, and high-performance pipelines.

The ideal candidate will bring both technical depth and strategic thinking, with the ability to communicate effectively across business and technical teams.

Key Responsibilities

Design and lead the development of scalable, secure, and high-performance data warehouse solutions for BI and analytics.
Define and drive the long-term architecture and data strategy in alignment with business goals.
Own orchestration of ETL/ELT workflows using Apache Airflow, including scheduling, monitoring, and alerting.
Collaborate with cross-functional teams (Product, Engineering, Data Science, Compliance) to define data requirements and build reliable data flows.
Champion best practices in data modelling, governance, and DevOps for data engineering (CI/CD, IaC).
Serve as a key communicator between technical teams and business stakeholders, translating complex data needs into actionable plans.
Mentor and lead data engineers, fostering continuous learning and technical excellence.
Ensure compliance with data security, privacy, and regulatory standards (e.g., PCI-DSS, GDPR).

Essential:

7+ years in Data Engineering, with 2+ years in a Principal or Lead role.
Proven experience designing and delivering enterprise data strategies.
Exceptional communication and stakeholder management skills.
Expertise in enterprise-grade data warehouses (Snowflake, BigQuery, Redshift).
Hands-on experience with Apache Airflow (or similar orchestration tools).
Strong proficiency in Python and SQL for pipeline development.
Deep understanding of data architecture, dimensional modelling, and metadata management.
Experience with cloud platforms (AWS, GCP, or Azure).
Familiarity with version control, CI/CD, and Infrastructure-as-Code (Terraform or similar).

Desirable:

Background in fintech or payments.
Knowledge of streaming frameworks (Kafka, Kinesis).
Experience with dbt and data quality frameworks (e.g., Great Expectations).

What's on Offer

Competitive base salary + bonus
Flexible hybrid working model (Liverpool Street office)
Private healthcare & wellness benefits
Learning and development support
The opportunity to shape the future of payments data infrastructure

Related Jobs

View all jobs

Principle Data Engineer ( AWS & Airflow )

Principle Data Engineer

Data Engineer

Senior Machine Learning Engineer

Senior Data Engineer (SC Cleared)

Senior Data Engineer (SC Cleared)

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Ultimate Assessment-Centre Survival Guide for Machine Learning Jobs in the UK

Assessment centres for machine learning positions in the UK are designed to reflect the complexity and collaboration required in real-world ML projects. From psychometric assessments and live model-building tasks to group data science challenges and behavioural interviews, recruiters evaluate your statistical understanding, coding skills, communication and teamwork. Whether you specialise in deep learning, reinforcement learning or NLP, this guide offers a step-by-step approach to excel at every stage and secure your next ML role.

Top 10 Mistakes Candidates Make When Applying for Machine-Learning Jobs—And How to Avoid Them

Landing a machine-learning job in the UK is competitive. Learn the 10 biggest mistakes applicants make—plus tested fixes, expert resources and live links that will help you secure your next ML role. Introduction From fintechs in London’s Square Mile to advanced-research hubs in Cambridge, demand for machine-learning talent is exploding. Job boards such as MachineLearningJobs.co.uk list new vacancies daily, and LinkedIn shows more than 10,000 open ML roles across the UK right now. Yet hiring managers still reject most CVs long before interview—often for avoidable errors. Below are the ten most common mistakes we see, each paired with a practical fix and a live resource link so you can dive deeper.

Top 10 Best UK Universities for Machine Learning Degrees (2025 Guide)

Explore ten UK universities that deliver world-class machine-learning degrees in 2025. Compare entry requirements, course content, research strength and industry links to find the programme that fits your goals. Machine learning (ML) has shifted from academic curiosity to the engine powering everything from personalised medicine to autonomous vehicles. UK universities have long been pioneers in the field, and their programmes now blend rigorous theory with hands-on practice on industrial-scale datasets. Below, we highlight ten institutions whose undergraduate or postgraduate pathways focus squarely on machine learning. League tables move each year, but these universities consistently excel in teaching, research and collaboration with industry.