Lead AWS Data Engineer

Two Circles
London
9 months ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer (AD -Consulting) - Exclusive

AWS Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Lead Data Engineer - Snowflake, DBT, Airflow - London - £100k

About Us:

Two Circles is a data-driven sports marketing agency. We work with some of the world’s biggest sports organisations – including the NFL, Premier League, Formula 1, Wimbledon and UEFA – and have four times been named Sport Industry Agency of the Year.

Every day, our team analyses billions of pieces of behavioural, attitudinal and purchase data from sports fans spanning the globe, using the latest machine-learning and data visualisation technology. We do this to give our clients the tools and insight required to grow their businesses and achieve their objectives in areas such as event day, media, sponsorship and participation.

We have a team of just over 600 Two Circlers working from eight offices across the world (LA, Kansas City, Miami, NYC, London, Paris, Bern and Melbourne) who work cross-region to service our expanding international client base.

About the team:

As part of our ongoing growth, we are looking to innovate with our technology stack and are seeking a talented Lead Data Engineer (AWS) to join our growing team and help us deliver innovative data solutions for clients and build our data management and analytics platform.

It is a fantastic opportunity for a smart, dynamic and ambitious person interested in working for sport’s most exciting agency at our UK headquarters, located at the heart of London’s technology hub.

As a data engineer you will play a key role in our team of engineers designing, building, testing & supporting data and BI solutions for the largest sporting organisations in the world. With a passion for technology you will help drive innovative solutions for our client, always pushing for higher standards and better quality. Working within a talented team of engineers you will have huge opportunities to both learn yourself and help mentor junior members.

Delivery is managed using Agile methodologies and you will embody the principles of integration, innovation, learning, communication and teamwork.

This role will be part of the Data & Analytics Squad.

Requirements

Your main duties & responsibilities:

Design, build and unit test of aspects data services, from ingestion, through harmonisation and transformation into business usable analytics. Input into high level design and responsibility for low level design • Hands on development of data pipelines using Step functions, Glue, Python/Pyspark and DBT(Redshift). Thorough and high-quality automated Unit testing • Creation of accurate, insightful & informative technical documentation • Performance analysis & improvement Handover and upskill of Operational teams Protecting the data entrusted to us by our clients at all times Internal mentoring and helping define learning pathways within the team The ideal background and skills we are looking for include: A passion for technology with a flair for finding innovative solutions A talent for Design with a keen eye for detail, structured thinking and best practice Identifying and analysing business, client or project requirements and translating them into technical deliverables Experience in developing Data solution with the following technical skills: Experience working with data, ideally in the Analytics space SQL, ideally Redshift or Snowflake • DevOps Pipelines or CI/CD (ideally AWS) – build, maintain or run.

Experience with the following would also be beneficial:

Working within an Agile delivery framework Lambda Functions AWS Database Experience - RDS/Dynamo DB/Redshift Glue/Databricks - Spark Cluster understanding/management

Though these are the basics written down, we will principally be recruiting for energy, values and commitment – both to Two Circles and to your career. Our recruitment process will be honest & thorough, and so will our roles.

In return, we can offer honesty, integrity, and the chance to progress in the organisation as quickly as you develop within it. Two Circles is committed to creating a diverse environment and is proud to be an equal opportunity employer.

All qualified applicants will receive consideration for employment without regard to race, colour, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Portfolio Projects That Get You Hired for Machine Learning Jobs (With Real GitHub Examples)

In today’s data-driven landscape, the field of machine learning (ML) is one of the most sought-after career paths. From startups to multinational enterprises, organisations are on the lookout for professionals who can develop and deploy ML models that drive impactful decisions. Whether you’re an aspiring data scientist, a seasoned researcher, or a machine learning engineer, one element can truly make your CV shine: a compelling portfolio. While your CV and cover letter detail your educational background and professional experiences, a portfolio reveals your practical know-how. The code you share, the projects you build, and your problem-solving process all help prospective employers ascertain if you’re the right fit for their team. But what kinds of portfolio projects stand out, and how can you showcase them effectively? This article provides the answers. We’ll look at: Why a machine learning portfolio is critical for impressing recruiters. How to select appropriate ML projects for your target roles. Inspirational GitHub examples that exemplify strong project structure and presentation. Tangible project ideas you can start immediately, from predictive modelling to computer vision. Best practices for showcasing your work on GitHub, personal websites, and beyond. Finally, we’ll share how you can leverage these projects to unlock opportunities—plus a handy link to upload your CV on Machine Learning Jobs when you’re ready to apply. Get ready to build a portfolio that underscores your skill set and positions you for the ML role you’ve been dreaming of!

Machine Learning Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

Machine learning is fuelling innovation across every industry, from healthcare to retail to financial services. As organisations look to harness large datasets and predictive algorithms to gain competitive advantages, the demand for skilled ML professionals continues to soar. Whether you’re aiming for a machine learning engineer role or a research scientist position, strong interview performance can open doors to dynamic projects and fulfilling careers. However, machine learning interviews differ from standard software engineering ones. Beyond coding proficiency, you’ll be tested on algorithms, mathematics, data manipulation, and applied problem-solving skills. Employers also expect you to discuss how to deploy models in production and maintain them effectively—touching on MLOps or advanced system design for scaling model inferences. In this guide, we’ve compiled 30 real coding & system‑design questions you might face in a machine learning job interview. From linear regression to distributed training strategies, these questions aim to test your depth of knowledge and practical know‑how. And if you’re ready to find your next ML opportunity in the UK, head to www.machinelearningjobs.co.uk—a prime location for the latest machine learning vacancies. Let’s dive in and gear up for success in your forthcoming interviews.

Negotiating Your Machine Learning Job Offer: Equity, Bonuses & Perks Explained

How to Secure a Compensation Package That Matches Your Technical Mastery and Strategic Influence in the UK’s ML Landscape Machine learning (ML) has rapidly shifted from an emerging discipline to a mission-critical function in modern enterprises. From optimising e-commerce recommendations to powering autonomous vehicles and driving innovation in healthcare, ML experts hold the keys to transformative outcomes. As a mid‑senior professional in this field, you’re not only crafting sophisticated algorithms; you’re often guiding strategic decisions about data pipelines, model deployment, and product direction. With such a powerful impact on business results, companies across the UK are going beyond standard salary structures to attract top ML talent. Negotiating a compensation package that truly reflects your value means looking beyond the numbers on your monthly payslip. In addition to a competitive base salary, you could be securing equity, performance-based bonuses, and perks that support your ongoing research, development, and growth. However, many mid‑senior ML professionals leave these additional benefits on the table—either because they’re unsure how to negotiate them or they simply underestimate their long-term worth. This guide explores every critical aspect of negotiating a machine learning job offer. Whether you’re joining an AI-focused start-up or a major tech player expanding its ML capabilities, understanding equity structures, bonus schemes, and strategic perks will help you lock in a package that matches your technical expertise and strategic influence. Let’s dive in.