Senior AWS Data Engineer

Two Circles
London
9 months ago
Applications closed

Related Jobs

View all jobs

Senior Manager, Modern Data Engineering

Senior Data Engineer

Data Engineering Lead

Senior Data Engineer - Snowflake & AWS

Lead/Senior Data Engineer

Scala Senior Data Engineer

Internally known as a AWS Data Engineer Lead

About Us:

Two Circles is a data-driven sports marketing agency. We work with some of the world’s biggest sports organisations – including the NFL, Premier League, Formula 1, Wimbledon and UEFA – and have four times been named Sport Industry Agency of the Year.

Every day, our team analyses billions of pieces of behavioural, attitudinal and purchase data from sports fans spanning the globe, using the latest machine-learning and data visualisation technology. We do this to give our clients the tools and insight required to grow their businesses and achieve their objectives in areas such as event day, media, sponsorship and participation.

We have a team of just over 600 Two Circlers working from eight offices across the world (LA, Kansas City, Miami, NYC, London, Paris, Bern and Melbourne) who work cross-region to service our expanding international client base.

About the team:

As part of our ongoing growth, we are looking to innovate with our technology stack and are seeking a talented Lead Data Engineer (AWS) to join our growing team and help us deliver innovative data solutions for clients and build our data management and analytics platform.

It is a fantastic opportunity for a smart, dynamic and ambitious person interested in working for sport’s most exciting agency at our UK headquarters, located at the heart of London’s technology hub.

As a data engineer you will play a key role in our team of engineers designing, building, testing & supporting data and BI solutions for the largest sporting organisations in the world. With a passion for technology you will help drive innovative solutions for our client, always pushing for higher standards and better quality. Working within a talented team of engineers you will have huge opportunities to both learn yourself and help mentor junior members.

Delivery is managed using Agile methodologies and you will embody the principles of integration, innovation, learning, communication and teamwork.

This role will be part of the Data & Analytics Squad.

Requirements

Your main duties & responsibilities:

Design, build and unit test of aspects data services, from ingestion, through harmonisation and transformation into business usable analytics. Input into high level design and responsibility for low level design • Hands on development of data pipelines using Step functions, Glue, Python/Pyspark and DBT(Redshift). Thorough and high-quality automated Unit testing • Creation of accurate, insightful & informative technical documentation • Performance analysis & improvement Handover and upskill of Operational teams Protecting the data entrusted to us by our clients at all times Internal mentoring and helping define learning pathways within the team The ideal background and skills we are looking for include: A passion for technology with a flair for finding innovative solutions A talent for Design with a keen eye for detail, structured thinking and best practice Identifying and analysing business, client or project requirements and translating them into technical deliverables Experience in developing Data solution with the following technical skills: Experience working with data, ideally in the Analytics space SQL, ideally Redshift or Snowflake • DevOps Pipelines or CI/CD (ideally AWS) – build, maintain or run.

Experience with the following would also be beneficial:

Working within an Agile delivery framework Lambda Functions AWS Database Experience - RDS/Dynamo DB/Redshift Glue/Databricks - Spark Cluster understanding/management

Though these are the basics written down, we will principally be recruiting for energy, values and commitment – both to Two Circles and to your career. Our recruitment process will be honest & thorough, and so will our roles.

In return, we can offer honesty, integrity, and the chance to progress in the organisation as quickly as you develop within it. Two Circles is committed to creating a diverse environment and is proud to be an equal opportunity employer.

All qualified applicants will receive consideration for employment without regard to race, colour, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Jobs in the Public Sector: Opportunities Across GDS, NHS, MOD, and More

Machine learning (ML) has rapidly moved from academic research labs to the heart of industrial and governmental operations. Its ability to uncover patterns, predict outcomes, and automate complex tasks has revolutionised industries ranging from finance to retail. Now, the public sector—encompassing government departments, healthcare systems, and defence agencies—has become an increasingly fertile ground for machine learning jobs. Why? Because government bodies oversee vast datasets, manage critical services for millions of citizens, and must operate efficiently under tight resource constraints. From using ML algorithms to improve patient outcomes in the NHS, to enhancing cybersecurity within the Ministry of Defence (MOD), there’s a growing demand for skilled ML professionals in UK public sector roles. If you’re passionate about harnessing data-driven insights to solve large-scale problems and contribute to societal well-being, machine learning jobs in the public sector offer an unparalleled blend of challenge and impact. In this article, we’ll explore the key reasons behind the public sector’s investment in ML, highlight the leading organisations, outline common job roles, and provide practical guidance on securing a machine learning position that helps shape the future of government services.

Contract vs Permanent Machine Learning Jobs: Which Pays Better in 2025?

Machine learning (ML) has swiftly become one of the most transformative forces in the UK technology landscape. From conversational AI and autonomous vehicles to fraud detection and personalised recommendations, ML algorithms are reshaping how organisations operate and how consumers experience products and services. In response, job opportunities in machine learning—including roles in data science, MLOps, natural language processing (NLP), computer vision, and more—have risen dramatically. Yet, as the demand for ML expertise booms, professionals face a pivotal choice about how they want to work. Some choose day‑rate contracting, leveraging short-term projects for potentially higher immediate pay. Others embrace fixed-term contract (FTC) roles for mid-range stability, or permanent positions for comprehensive benefits and a well-defined career path. In this article, we will explore these different employment models, highlighting the pros and cons of each, offering sample take‑home pay scenarios, and providing insights into which path might pay better in 2025. Whether you’re a new graduate with a machine learning degree or an experienced practitioner pivoting into an ML-heavy role, understanding these options is key to making informed career decisions.

Machine‑Learning Jobs for Non‑Technical Professionals: Where Do You Fit In?

The Model Needs More Than Math When ChatGPT went viral and London start‑ups raised seed rounds around “foundation models,” many professionals asked, “Do I need to learn PyTorch to work in machine learning?” The answer is no. According to the Turing Institute’s UK ML Industry Survey 2024, 39 % of advertised ML roles focus on strategy, compliance, product or operations rather than writing code. As models move from proof‑of‑concept to production, demand surges for specialists who translate algorithms into business value, manage risk and drive adoption. This guide reveals the fastest‑growing non‑coding ML roles, the transferable skills you may already have, real transition stories and a 90‑day action plan—no gradient descent necessary.