Lead Data Engineer

Made Tech Limited
City of London
1 month ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer - Hadoop - Spark - Python

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‑lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage.


Key responsibilities

  • Define, shape and perfect data strategies in central and local government.
  • Help public sector teams understand the value of their data, and make the most of it.
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.
  • As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities.

Skills, knowledge and expertise

We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.



  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies.
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments.
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines.
  • Able to document and present end‑to‑end diagrams to explain a data processing system on a cloud environment.
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self‑development.
  • You have experience of working on agile delivery‑lead projects and can apply agile practices such as Scrum, XP, Kanban.
  • Can own the cloud infrastructure underpinning data systems through a DevOps approach.
  • Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.
  • You are a skilled Data Engineer who has delivered data platforms.
  • Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
  • You can demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders.
  • You have the experience to improve resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit integration, data quality, etc)
  • You are skilled at offering guidance on how one would implement a robust DevOps approach in a data project.
  • You can comfortably talk about tools needed such as DataOps in areas such as orchestration, data integration and data analytics.

Experience in the following things isn’t essential, but it’s highly desirable!



  • Working at a technology consultancy
  • Working with Docker and virtual environments as part of the development and CI/CD process.
  • Working with senior stakeholders to gather requirements and keep them engaged with
  • Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models
  • Working knowledge of statistics
  • Working with multidisciplinary digital and technology teams
  • Working within the public sector
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models

We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.


Here are some of our most popular benefits listed below:


👩💻 Remote Working - we offer part time remote working for all our staff


An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we’re looking for all successful candidates for this role to have eligibility. Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full‑time education). Ideally, no more than 30 consecutive days spent outside the UK within the last five years. Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won’t be able to progress your application and we will contact you to let you know why.


Sounds good?

Join us in our mission to use technology to improve society for everyone.


Our hiring process is designed to be thorough, transparent, and supportive, guiding candidates through each step. The exact process may vary slightly depending on the role but these are the typical steps candidates can expect.


We’ll keep you updated throughout the process and provide helpful feedback at each stage. No matter the outcome, we make sure the feedback is useful and supportive, so you feel informed and can learn from the experience.


Our talent team will review all applications, and while we may use AI to help speed up the process, a real human will always make the final decisions. Once reviewed, shortlisted applicants will be invited to a screening.


Register your interest to be notified of any roles that come along that meet your criteria.


#J-18808-Ljbffr

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.

MLOps Jobs in the UK: The Complete Career Guide for Machine Learning Professionals

Machine learning has moved from experimentation to production at scale. As a result, MLOps jobs have become some of the most in-demand and best-paid roles in the UK tech market. For job seekers with experience in machine learning, data science, software engineering or cloud infrastructure, MLOps represents a powerful career pivot or progression. This guide is designed to help you understand what MLOps roles involve, which skills employers are hiring for, how to transition into MLOps, salary expectations in the UK, and how to land your next role using specialist platforms like MachineLearningJobs.co.uk.