National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Senior Data Engineer (Remote)

Circana
London
3 days ago
Create job alert

Join to apply for the Senior Data Engineer (Remote) role at Circana
Join to apply for the Senior Data Engineer (Remote) role at Circana
At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified by Great Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana.

Learn more atwww.circana.com.

What will you be doing?

We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply!

Job Responsibilities

ETL/ELT Pipeline Development:
Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow.
Implement batch and real-time data processing solutions using Apache Spark.
Ensure data quality, governance, and security throughout the data lifecycle.
Cloud Data Engineering:
Manage and optimize cloud infrastructure (Azure) for data processing workloads, with a focus on cost-effectiveness.
Implement and maintain CI/CD pipelines for data workflows to ensure smooth and reliable deployments.
Big Data & Analytics:
Develop and optimize large-scale data processing pipelines using Apache Spark and PySpark.
Implement data partitioning, caching, and performance tuning techniques to enhance Spark-based workloads.
Work with diverse data formats (structured and unstructured) to support advanced analytics and machine learning initiatives.
Workflow Orchestration (Airflow):
Design and maintain DAGs (Directed Acyclic Graphs) in Apache Airflow to automate complex data workflows.
Monitor, troubleshoot, and optimize job execution and dependencies within Airflow.
Team Leadership & Collaboration:
Provide technical guidance and mentorship to a team of data engineers in India.
Foster a collaborative environment and promote best practices for coding standards, version control, and documentation.

Requirements

Client facing role so strong communication and collaboration skills are vital
Proven experience in data engineering, with hands-on expertise in Azure Data Services, PySpark, Apache Spark, and Apache Airflow.
Strong programming skills in Python and SQL, with the ability to write efficient and maintainable code.
Deep understanding of Spark internals, including RDDs, DataFrames, DAG execution, partitioning, and performance optimization techniques.
Experience with designing and managing Airflow DAGs, scheduling, and dependency management.
Knowledge of CI/CD pipelines, containerization technologies (Docker, Kubernetes), and DevOps principles applied to data workflows.
Excellent problem-solving skills and a proven ability to optimize large-scale data processing tasks.
Prior experience in leading teams and working in Agile/Scrum development environments.
A track record of working effectively global remote teams

Desirable:

Experience with data modelling and data warehousing concepts.
Familiarity with data visualization tools and techniques.
Knowledge of machine learning algorithms and frameworks.

Circana Behaviours

As well as the technical skills, experience and attributes that are required for the role, our shared behaviours sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviours throughout the business within their day-to-day role:

Stay Curious: Being hungry to learn and grow, always asking the big questions.
Seek Clarity: Embracing complexity to create clarity and inspire action.
Own the Outcome: Being accountable for decisions and taking ownership of our choices.
Center on the Client: Relentlessly adding value for our customers.
Be a Challenger: Never complacent, always striving for continuous improvement.
Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity.
Commit to each other: Contributing to making Circana a great place to work for everyone.

Location

This position can be located in the following area(s): Bracknell

Seniority level Seniority level Mid-Senior level
Employment type Employment type Full-time
Job function Job function Information Technology
Industries Market Research
Referrals increase your chances of interviewing at Circana by 2x
Get notified about new Senior Data Engineer jobs in United Kingdom .
London Area, United Kingdom $100,000.00-$120,000.00 2 weeks ago
London, England, United Kingdom 3 weeks ago
Senior Data Analyst, Strategic Marketing London, England, United Kingdom 3 weeks ago
Adderbury, England, United Kingdom 1 month ago
Greater London, England, United Kingdom 1 week ago
City Of London, England, United Kingdom 1 week ago
Greater London, England, United Kingdom 2 days ago
London, England, United Kingdom 1 week ago
London, England, United Kingdom 4 days ago
Manchester, England, United Kingdom 1 week ago
Senior Fraud Strategy Data Analyst - Control Optimisation London, England, United Kingdom 1 month ago
Birmingham, England, United Kingdom 1 week ago
Edinburgh, Scotland, United Kingdom 1 week ago
London, England, United Kingdom 1 week ago
Newcastle Upon Tyne, England, United Kingdom 1 week ago
Manchester, England, United Kingdom 1 week ago
London, England, United Kingdom 2 days ago
Senior React Native Engineer - Outside of IR-35 London, England, United Kingdom 2 months ago
London, England, United Kingdom 5 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer - Snowflake - £100,000 - London - Hybrid

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Present Machine Learning Solutions to Non-Technical Audiences: A Public Speaking Guide for Job Seekers

Machine learning is driving change across nearly every industry—from retail and finance to health and logistics. But while the technology continues to evolve rapidly, the ability to communicate it clearly has become just as important as building the models themselves. Whether you're applying for a junior ML engineer role, a research position, or a client-facing AI consultant job, UK employers increasingly expect candidates to explain complex machine learning solutions to non-technical audiences. In this guide, you’ll learn how to confidently present your work, structure your message, use simple visuals, and explain the real-world value of machine learning in a way that makes sense to people without a background in data science.

Machine Learning Jobs UK 2025: 50 Companies Hiring Now

Bookmark this page—we refresh the Hotlist every quarter so you always know who’s really scaling their ML teams. The UK’s National AI Strategy, a £2 billion GenAI accelerator fund and a record flow of private capital have kicked ML hiring into overdrive for 2025. Whether you build production‑grade LLM services or optimise on‑device models for edge hardware, employers need your skills now. Below you’ll find 50 organisations that advertised UK‑based machine‑learning vacancies or announced head‑count growth during the past eight weeks. They’re grouped into five quick‑scan categories so you can jump straight to the type of employer—and mission—that excites you. For each company we list: Main UK hub Example live or recent vacancy Why it’s worth a look (stack, impact, culture) Search any employer on MachineLearningJobs.co.uk to see real‑time adverts, or set a free alert so fresh openings drop straight in your inbox.

Return-to-Work Pathways: Relaunch Your Machine Learning Career with Returnships, Flexible & Hybrid Roles

Returning to work after an extended break can feel like starting from scratch—especially in a specialist field like machine learning. Whether you paused your career for parenting, caring responsibilities or another life chapter, the UK’s machine learning sector now offers a variety of return-to-work pathways. From structured returnships to flexible and hybrid roles, these programmes recognise the transferable skills and resilience you’ve developed, pairing you with mentorship, upskilling and supportive networks to ease your transition back. In this guide, you’ll discover how to: Understand the current demand for machine learning talent in the UK Leverage your organisational, communication and analytical skills in ML contexts Overcome common re-entry challenges with practical solutions Refresh your technical knowledge through targeted learning Access returnship and re-entry programmes tailored to machine learning Find roles that fit around family commitments—whether flexible, hybrid or full-time Balance your career relaunch with caring responsibilities Master applications, interviews and networking specific to ML Learn from inspiring returner success stories Get answers to common questions in our FAQ section Whether you aim to return as an ML engineer, research scientist, MLOps specialist or data scientist with an ML focus, this article will map out the steps and resources you need to reignite your machine learning career.