Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

Smarkets
London
5 days ago
Create job alert

Who Are We?

Smarkets is transforming the betting exchange space by delivering world-class technology and the best-priced markets in the industry. With over £35 billion in traded volume since 2010, we’ve built a product-led, transparent, and fair platform that challenges the norms of traditional betting.

As a Series B tech company, we pride ourselves on engineering excellence, lean product thinking, and scientific rigor. With a close-knit team and a passion for innovation, Smarkets is where top talent comes to make a real impact.

Now, we’re looking for a Data Engineer to help take the wealth of Data that we generate and use it to drive insights to improve the business.

About the Role

You’ll join the Data Team, the group that transforms Smarkets’ vast streams of data into insights and systems that power decisions across the business. From sports event data and payments, to order flow and user analytics, you’ll work with some of the most diverse and high-volume data in the industry.

This isn’t just data engineering—you’ll be building the pipelines, services, and platforms that underpin our analytics, ML models, and business reporting. You’ll shape how we collect, process, and serve data at scale, creating the foundations for smarter decisions and better products.

What You’ll Do

Design and Own Pipelines: Build and maintain ETL pipelines (batch and real-time) that turn raw data into reliable, usable insights.

Build Data Services: Develop Python/Flask APIs and Postgres services that expose data and manage business entities.

Support Analytics & Reporting: Automate reporting pipelines, design data models, and empower teams with accurate dashboards.

Enable Data Science: Train and deploy ML models for segmentation, anomaly detection, and recommendations—contributing to our existing recommender service.

Operate Data Infrastructure: Keep our data warehouses (Redshift, BigQuery) healthy, scalable, and performant.

Collaborate & Mentor: Work closely with data scientists, analysts, and engineers across teams, helping raise the bar for data excellence.

Your Toolkit

Languages & Frameworks: Python (pandas, NumPy, scikit-learn), Flask, Bash.

Pipelines & Orchestration: ETL frameworks such as Luigi or Airflow.

Data Infrastructure: PostgreSQL, AWS Redshift, Google BigQuery, dbt, Kafka.

Ops & Monitoring: Docker, Kubernetes, Jenkins, Prometheus, Grafana, ElasticSearch, Kibana, Sisense.

ML & Analytics: Model training and deployment workflows, user segmentation, anomaly detection.

What You Bring

Professional experience in data engineering.

Hands-on experience building ETL pipelines in Python.

Background in developing APIs/services with Python and databases.

Familiarity with the Python data science stack and deploying ML models.

An eye for writing maintainable, well-tested code.

A collaborative, proactive attitude and a desire to learn.

A degree in Computer Science, Math, or equivalent experience.

Our Values

Push to win

Make others better

Give a shit

Be a pro

Bring the energy

Our values shape everything we do—from how we build systems to how we support each other. We want engineers who care about impact, quality, and team success.

Benefits

Stock options with 4-year vesting

6% matched pension scheme via Aviva

Health insurance

Daily in-office lunch prepared by our chef, plus snacks, coffee, and drinks

Cycle to work scheme

£1,000 yearly education budget for courses, books, or conferences

25 days paid holiday + bank holidays, with 5 carry-over days

Flexible hybrid model (2 days a week from home)

20 days per year of global working

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Future of Machine Learning Jobs: Careers That Don’t Exist Yet

Machine learning (ML) has become one of the most powerful forces reshaping the modern world. From voice assistants and recommendation engines to fraud detection and medical imaging, it underpins countless applications. ML is no longer confined to research labs—it powers business models, public services, and consumer technologies across the globe. In the UK, demand for machine learning professionals has risen dramatically. Organisations in finance, retail, healthcare, and defence are embedding ML into their operations. Start-ups in Cambridge, London, and Edinburgh are pioneering innovations, while government-backed initiatives aim to position the UK as a global AI leader. Salaries for ML engineers and researchers are among the highest in the tech sector. Yet despite its current importance, machine learning is only at the beginning of its journey. Advances in generative AI, quantum computing, robotics, and ethical governance will reshape the profession. Many of the most vital machine learning jobs of the next two decades don’t exist today. This article explores why new careers will emerge, the roles likely to appear, how today’s roles will evolve, why the UK is well positioned, and how professionals can prepare now.

Seasonal Hiring Peaks for Machine Learning Jobs: The Best Months to Apply & Why

The UK's machine learning sector has evolved into one of Europe's most intellectually stimulating and financially rewarding technology markets, with roles spanning from junior ML engineers to principal machine learning scientists and heads of artificial intelligence research. With machine learning positions commanding salaries from £32,000 for graduate ML engineers to £160,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this pioneering and rapidly evolving field. Unlike traditional software engineering roles, machine learning hiring follows distinct patterns influenced by AI research cycles, model development timelines, and algorithmic innovation schedules. The sector's unique combination of mathematical rigour, computational complexity, and real-world application requirements creates predictable hiring windows that strategic professionals can leverage to advance their careers in developing tomorrow's intelligent systems. This comprehensive guide explores the optimal timing for machine learning job applications in the UK, examining how enterprise AI strategies, academic research cycles, and deep learning initiatives influence recruitment patterns, and why strategic timing can determine whether you join a groundbreaking AI research team or miss the opportunity to develop the next generation of machine learning algorithms.

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.