(Senior) Lead Data Engineer

IFS
Staines-upon-Thames
2 months ago
Create job alert

Job Description

Are you ready to make waves in the world of AI? We're on the hunt for a Senior/Lead Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always chasing that next level of excellence.

You'll be at the forefront of infusing cutting-edge advanced analytics and AI into IFS Cloud, revolutionizing Enterprise Resource Planning, Asset Management, and Field Service Management. Get ready to tackle high-stakes challenges like IIoT, predictive maintenance, forecasting, anomaly detection, optimization, and unleashing generative AI. Your data engineer wizardry will power our solutions, crafting efficient data pipelines, expanding our data platform capabilities, and pushing the envelope of data-driven innovation across our product lineup.

Your sharp critical thinking and knack for real-world business dilemmas will be instrumental in orchestrating end-to-end solutions. From spotting opportunities on the horizon to delivering high-performance, scalable data solutions, you'll play a pivotal role in our success.

If you're a maestro of mapping business processes and deciphering complex data, if advanced analytics and AI are your jam, and if you take pride in building top-tier data pipelines for production environments, we want to hear from you.

How Will You Shape the Future?

This role is all about hands-on technical prowess, and we expect you to bring your A-game. You'll be in the driver's seat, working with autonomy, accountability, and technical brilliance. Your mission includes:

Spotting high-value data opportunity within our IFS offerings, translating raw data into powerful features and reusable data assets. Serving as our data expert, guiding us towards the latest and greatest data technology and platform trends. You'll be the guru driving our data platform evolution and providing data project estimates. Leading the Data Engineering team in crafting and integrating data projects from the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment. You will ensure scalability and top-tier performance. Locking arms with ML Engineers, Data Scientists, Architects, and Product/Program Managers. Together, you'll define, create, deploy, monitor, and document data pipelines to power advanced AI solutions. Becoming our data technology evangelist. Get ready to shine on the conference stage, host webinars, and pen compelling white papers and blogs. Share your discoveries with clients and internal stakeholders, offering actionable insights that drive change.

Qualifications

To succeed in this role, you'll need:

7+ years of data engineering experience, skilled in scalable solutions like Data Lakes/Lakehouse, Graph and Vector Databases (, ADLS, Elasticsearch, MongoDB, Azure AI search, etc.).

Proficient in data pipelines across cloud/on-premises, using Azure and other technologies. Experienced in orchestrating data workflows and Kubernetes clusters on AKS using Airflow, Kubeflow, Argo, Dagster or similar. Skilled with data ingestion tools like Airbyte, Fivetran, etc. for diverse data sources. Expert in large-scale data processing with Spark or Dask. Strong in Python, Scala, C# or Java, cloud SDKs and APIs. AI/ML expertise for pipeline efficiency, familiar with TensorFlow, PyTorch, AutoML, Python/R, and MLOps (MLflow, Kubeflow). Solid in DevOps, CI/CD automation with Bitbucket Pipelines, Azure DevOps, GitHub. Automate deployment of data pipelines and applications using Bash, PowerShell, or Azure CLI, Terraform, Helm Chats etc. Experienced in leveraging Azure AI Search, MongoDB, Elasticsearch or other hybrid/vector stores for content analysis and indexing, with a focus on creating advanced RAG (Retrieval Augmented Generation) applications. Proficiency in building IoT data pipelines, encompassing real-time data ingestion, transformation, security, scalability, and seamless integration with IoT platforms. Design, develop, and monitor streaming data applications using Kafka and related technologies.

Ready to make your mark? Join us on this exhilarating journey, where you'll be a vital part of our AI revolution. Let's transform the future together!

Related Jobs

View all jobs

Data Engineer

Sales Operations Analyst

Data Engineer

Data Scientist/Machine Learning Engineer - RNA Design

Data Analytics Developer - March 2025

Lead Data Engineer - Snowflake, DBT, Airflow - London - £100k

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How to Write a Winning Cover Letter for Machine Learning Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for machine learning jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the machine learning sector. When applying for a machine learning job, your cover letter is a vital part of your application. Machine learning is an exciting and rapidly evolving field, and your cover letter offers the chance to demonstrate your technical expertise, passion for AI, and your ability to apply machine learning techniques to solve real-world problems. Writing a cover letter for machine learning roles may feel intimidating, but by following a clear structure, you can showcase your strengths effectively. Whether you're just entering the field, transitioning from another role, or looking to advance your career in machine learning, this article will guide you through a proven four-paragraph structure. We’ll provide practical tips and sample lines to help you create a compelling cover letter that catches the attention of hiring managers in the machine learning job market.

Veterans in Machine Learning: A Military‑to‑Civilian Pathway into AI Careers

Introduction Artificial intelligence is no longer relegated to sci‑fi films—it underpins battlefield decision‑support, fraud detection, and even supermarket logistics. The UK Government’s 2025 AI Sector Deal forecasts an additional £200 billion in GDP by 2030, with machine‑learning (ML) engineers cited as the nation’s second most in‑demand tech role (Tech Nation 2024). The Ministry of Defence’s Defence AI Strategy echoes that urgency, earmarking £1.6 billion for FY 2025–28 to embed ML into planning, logistics, and autonomous systems. If you have ever tuned a radar filter, plotted artillery trajectories, or sifted sensor data for actionable intel, you have already worked with statistical modelling—the backbone of machine learning. This guide shows UK veterans how to reframe military experience for ML roles, leverage MoD transition funding, and land high‑impact positions building the models shaping tomorrow’s defence and commercial landscapes. Quick Win: Bookmark our live board for Machine‑Learning Engineer roles to see who’s hiring today.

Rural-Remote Machine Learning Jobs: Finding Balance Beyond the Big Cities

Over the past decade, machine learning (ML) has transformed from a niche research domain into a pervasive technology underpinning everything from recommendation systems and voice assistants to financial forecasting and autonomous vehicles. Historically, the UK’s major tech hubs—particularly London—have been magnets for top ML talent and corporate headquarters. However, remote work has become mainstream, and many ML professionals are realising they can excel in their field while living far beyond the city limits. At MachineLearningJobs.co.uk, we’ve observed a growing interest in positions that allow for a rural lifestyle or a coastal environment, often reflected in search terms like “ML remote countryside” or “tech jobs by the sea.” This surge is no coincidence. Flexible work policies, better rural broadband, and the nature of machine learning tasks—much of which can be done through cloud platforms—are bringing new opportunities to those who wish to swap urban hustle for fresh air and scenic views. Whether you’re a data scientist, ML engineer, researcher, or product manager, a rural or seaside move could reinvigorate your work-life balance. In this article, we’ll unpack why rural-remote ML jobs are on the rise, how you can navigate the challenges of leaving the city, and what you need to do to thrive in a machine learning career beyond the M25. If you’ve dreamt of looking up from your laptop to rolling fields or ocean waves, keep reading—your rural ML role might be closer than you think.