National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Data Engineering Tech Lead

London
7 months ago
Applications closed

Related Jobs

View all jobs

Principal Data Engineer

Data Engineer

Head of Data Engineering (Ad Tech)

Senior Data Engineering Consultant

Data Engineering Manager- MarTech

Data Engineering Manager- MarTech

Data Engineer Tech Lead (Azure, Databricks Data Lakes)

12 month contract, hybrid with weekly visits to office in Central London.

Certain Advantage are recruiting for our global commodities trading client in London for a Data Engineer Tech Lead with extensive experience with Databricks, Apache Spark, and data lakes.

By taking on the role of Technical Lead you'll be joining a dynamic team leading the development of our client's data Lakehouse platform.

Make yourself standout if you have delivered projects in the streaming data world, have a good understanding of data governance and data quality best practices. Definitely shout out about any Energy trading experience you can offer!

Responsibilities:

Lead the design, development, and implementation of data engineering solutions for our data Lakehouse platform.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Provide technical leadership, mentoring, and coaching to the data engineering team.
Ensure best practices in data engineering, including data modeling, ETL processes, and data quality.
Optimize big data workloads in Spark and other big data technologies.
Manage CI/CD pipelines using Azure DevOps or Git.
Develop and maintain event-driven pipelines using .NET and other relevant technologies.
Implement and manage Databricks Unity Catalog and other data governance tools.
Deliver projects in the streaming data world using Kafka, KSQL DB, and similar technologies.
Utilize reporting tools such as Power BI and Qlik for data visualization and reporting.Your Technical Skills will hopefully include

Extensive experience with Databricks, Apache Spark, and data lakes.
Proficiency in Python and SQL.
Experience with CI/CD processes using Azure DevOps or Git.
Knowledge of streaming data technologies such as Kafka and KSQL DB.
Familiarity with reporting tools like Power BI and Qlik.
Software engineering experience with .NET for event-driven pipelines and automation testing.
Experience with Databricks Unity Catalog.
Strong skills in data modeling, including Snowflake modeling, star schema modeling, and other techniques.
Ability to optimize big data workloads in Spark.
Self-driven and motivated with a strong sense of ownership.
Proven experience in managing and inspiring technical teams.
Excellent communication and collaboration skills.
Ability to effectively interact with business and IT teams.
Strong problem-solving and analytical skills.
Ability to provide constructive feedback and foster a positive team environment.Does this sound like your next career move? Apply today!

Working with Certain Advantage

We go the extra mile to find the best people for the job. If you're hunting for a role where you can make an impact and grow your career, we'll work with you to find it.

We work with businesses across the UK to find the best people in Finance, Marketing, IT and Engineering.

If this job isn't for you, head to (url removed) and register for job alerts and career guidance tips

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Find Hidden Machine Learning Jobs in the UK Using Professional Bodies like BCS, Turing Society & More

Machine learning (ML) continues to transform sectors across the UK—from fintech and retail to healthtech and autonomous systems. But while the demand for ML engineers, researchers, and applied scientists is growing, many of the best opportunities are never posted on traditional job boards. So, where do you find them? The answer lies in professional bodies, academic-industry networks, and tight-knit ML communities. In this guide, we’ll show you how to uncover hidden machine learning jobs in the UK by engaging with groups like the BCS (The Chartered Institute for IT), Turing Society, Alan Turing Institute, and others. We’ll explore how to use member directories, CPD events, SIGs (Special Interest Groups), and community projects to build connections, gain early access to job leads, and raise your professional profile in the ML ecosystem.

How to Get a Better Machine Learning Job After a Lay-Off or Redundancy

Redundancy in machine learning can feel especially frustrating when your role was technically advanced, strategically important, or AI-facing. But the UK still has strong demand for machine learning professionals across fintech, healthtech, retail, cybersecurity, autonomous systems, and generative AI. Whether you're a research-oriented ML engineer, production-focused MLOps developer, or applied scientist, this guide is designed to help you bounce back from redundancy and find a better opportunity that suits your goals.

Machine Learning Jobs Salary Calculator 2025: Figure Out Your True Worth in Seconds

Why last year’s pay survey is useless for UK ML professionals today Ask a Machine Learning Engineer wrangling transformer checkpoints, an MLOps Lead firefighting drift alarms, or a Research Scientist training diffusion models at 3 a.m.: “Am I earning what I deserve?” The honest answer changes monthly. A single OpenAI model drop doubles GPU demand, healthcare regulators release fresh explainability guidance, & a fintech unicorn pays six figures for vector‑search expertise. Each shock nudges salary bands. Any PDF salary guide printed in 2024 now looks like an outdated Jupyter notebook—missing the gen‑AI tsunami, the surge in edge inference, & the UK’s new Responsible‑AI framework. To give ML professionals an accurate benchmark, MachineLearningJobs.co.uk distilled a transparent, three‑factor formula that estimates a realistic 2025 salary in under a minute. Feed in your discipline, UK region, & seniority; you’ll receive a defensible figure—no stale averages, no guesswork. This article unpacks the formula, highlights the forces driving ML pay skyward, & offers five practical moves to boost your value inside the next ninety days.