Engineer the Quantum RevolutionYour expertise can help us shape the future of quantum computing at Oxford Ionics.

View Open Roles

(Senior) Lead Data Engineer

IFS
Staines-upon-Thames
5 months ago
Applications closed

Related Jobs

View all jobs

Data Analyst – Azure Data Integration Project | Outside IR35 | Start August | Onsite in Bristol 3 Days/Week

Databricks Data Engineer

Finance Data Analyst

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid

Carbon Data Analyst

Senior Data Engineer

Job Description

Are you ready to make waves in the world of AI? We're on the hunt for a Senior/Lead Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always chasing that next level of excellence.

You'll be at the forefront of infusing cutting-edge advanced analytics and AI into IFS Cloud, revolutionizing Enterprise Resource Planning, Asset Management, and Field Service Management. Get ready to tackle high-stakes challenges like IIoT, predictive maintenance, forecasting, anomaly detection, optimization, and unleashing generative AI. Your data engineer wizardry will power our solutions, crafting efficient data pipelines, expanding our data platform capabilities, and pushing the envelope of data-driven innovation across our product lineup.

Your sharp critical thinking and knack for real-world business dilemmas will be instrumental in orchestrating end-to-end solutions. From spotting opportunities on the horizon to delivering high-performance, scalable data solutions, you'll play a pivotal role in our success.

If you're a maestro of mapping business processes and deciphering complex data, if advanced analytics and AI are your jam, and if you take pride in building top-tier data pipelines for production environments, we want to hear from you.

How Will You Shape the Future?

This role is all about hands-on technical prowess, and we expect you to bring your A-game. You'll be in the driver's seat, working with autonomy, accountability, and technical brilliance. Your mission includes:

Spotting high-value data opportunity within our IFS offerings, translating raw data into powerful features and reusable data assets. Serving as our data expert, guiding us towards the latest and greatest data technology and platform trends. You'll be the guru driving our data platform evolution and providing data project estimates. Leading the Data Engineering team in crafting and integrating data projects from the ground up. From framing problems and experimenting with new data sources and tools to the grand finale of data pipeline implementation and deployment. You will ensure scalability and top-tier performance. Locking arms with ML Engineers, Data Scientists, Architects, and Product/Program Managers. Together, you'll define, create, deploy, monitor, and document data pipelines to power advanced AI solutions. Becoming our data technology evangelist. Get ready to shine on the conference stage, host webinars, and pen compelling white papers and blogs. Share your discoveries with clients and internal stakeholders, offering actionable insights that drive change.

Qualifications

To succeed in this role, you'll need:

7+ years of data engineering experience, skilled in scalable solutions like Data Lakes/Lakehouse, Graph and Vector Databases (, ADLS, Elasticsearch, MongoDB, Azure AI search, etc.).

Proficient in data pipelines across cloud/on-premises, using Azure and other technologies. Experienced in orchestrating data workflows and Kubernetes clusters on AKS using Airflow, Kubeflow, Argo, Dagster or similar. Skilled with data ingestion tools like Airbyte, Fivetran, etc. for diverse data sources. Expert in large-scale data processing with Spark or Dask. Strong in Python, Scala, C# or Java, cloud SDKs and APIs. AI/ML expertise for pipeline efficiency, familiar with TensorFlow, PyTorch, AutoML, Python/R, and MLOps (MLflow, Kubeflow). Solid in DevOps, CI/CD automation with Bitbucket Pipelines, Azure DevOps, GitHub. Automate deployment of data pipelines and applications using Bash, PowerShell, or Azure CLI, Terraform, Helm Chats etc. Experienced in leveraging Azure AI Search, MongoDB, Elasticsearch or other hybrid/vector stores for content analysis and indexing, with a focus on creating advanced RAG (Retrieval Augmented Generation) applications. Proficiency in building IoT data pipelines, encompassing real-time data ingestion, transformation, security, scalability, and seamless integration with IoT platforms. Design, develop, and monitor streaming data applications using Kafka and related technologies.

Ready to make your mark? Join us on this exhilarating journey, where you'll be a vital part of our AI revolution. Let's transform the future together!

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Seasonal Hiring Peaks for Machine Learning Jobs: The Best Months to Apply & Why

The UK's machine learning sector has evolved into one of Europe's most intellectually stimulating and financially rewarding technology markets, with roles spanning from junior ML engineers to principal machine learning scientists and heads of artificial intelligence research. With machine learning positions commanding salaries from £32,000 for graduate ML engineers to £160,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this pioneering and rapidly evolving field. Unlike traditional software engineering roles, machine learning hiring follows distinct patterns influenced by AI research cycles, model development timelines, and algorithmic innovation schedules. The sector's unique combination of mathematical rigour, computational complexity, and real-world application requirements creates predictable hiring windows that strategic professionals can leverage to advance their careers in developing tomorrow's intelligent systems. This comprehensive guide explores the optimal timing for machine learning job applications in the UK, examining how enterprise AI strategies, academic research cycles, and deep learning initiatives influence recruitment patterns, and why strategic timing can determine whether you join a groundbreaking AI research team or miss the opportunity to develop the next generation of machine learning algorithms.

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.

Why Now Is the Perfect Time to Launch Your Career in Machine Learning: The UK's Intelligence Revolution

The United Kingdom stands at the epicentre of a machine learning revolution that's fundamentally transforming how we solve problems, deliver services, and unlock insights from data at unprecedented scale. From the AI-powered diagnostic systems revolutionising healthcare in Manchester to the algorithmic trading platforms driving London's financial markets, Britain's embrace of intelligent systems has created an extraordinary demand for skilled machine learning professionals that dramatically exceeds the current talent supply. If you've been seeking a career at the forefront of technological innovation or looking to position yourself in one of the most impactful sectors of the digital economy, machine learning represents an exceptional opportunity. The convergence of abundant data availability, computational power accessibility, advanced algorithmic development, and enterprise AI adoption has created perfect conditions for machine learning career success.