Engineer the Quantum RevolutionYour expertise can help us shape the future of quantum computing at Oxford Ionics.

View Open Roles

Lead Data Engineer

Omnis Partners
City of London
1 month ago
Applications closed

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer...

Lead Data Engineer (Only 24h Left)...

šŸ’¼ Lead Data Engineer ā€“ London ā€“ Ā£120,000

Sector:AI Consulting | Client Delivery

Type:Full-time | Hybrid


Join a tech consultancy at the forefront of applied AIā€”helping global brands design and deploy intelligent systems that solve real business problems. They combine deep engineering know-how with domain expertise to build the data infrastructure that powers machine learning and generative AI at scale.


šŸ” About the Role

As aLead Data Engineer, youā€™ll play a critical role in delivering AI-driven solutions for clientsā€”owning the architecture and development of robust, scalable data platforms that feed into machine learning models and intelligent applications.

Youā€™ll work closely with Data Scientists, MLOps Engineers, and domain experts to ensure clean, accessible, and production-grade data pipelines are in place to support experimentation and deployment.


šŸ› ļø Key Responsibilities

  • Build and maintain high-performance data pipelines to power AI/ML use cases
  • Architect cloud-native data platforms using tools likeDatabricks,Airflow,Snowflake, andSpark
  • Collaborate with AI/ML teams to align data processing with model requirements
  • Develop ETL/ELT workflows to support feature engineering, model training, and inference
  • Optimise data workflows for scalability, reliability, and cost-efficiency
  • Ensure security, compliance, and data governance standards (e.g.GDPR, RBAC)
  • Mentor junior engineers and guide technical decisions on client engagements


āœ… Ideal Experience

  • Strong inPythonandSQL, plus familiarity withScalaorJava
  • Experience supporting AI/ML workflows and working with Data Scientists
  • Exposure to cloud platforms:AWS,Azure, orGCP
  • Hands-on with modern data tooling:Spark,Databricks,Snowflake,Airflow
  • Solid grasp of data modelling, orchestration, and infrastructure-as-code (Terraform, Docker, CI/CD)
  • Excellent communication and client-facing skillsā€”comfortable leading on technical delivery


šŸŽ Whatā€™s on Offer

  • Ā£120k base + bonus + flexible benefits
  • Career progression into technical leadership or architecture
  • Training, certifications, and access to internal AI communities
  • Flexible/hybrid working, wellness support, and inclusive culture
  • The chance to work on impactful AI projects across multiple industries

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

The Future of Machine Learning Jobs: Careers That Donā€™t Exist Yet

Machine learning (ML) has quickly become one of the most transformative forces in modern technology. What began as a subset of artificial intelligenceā€”focused on algorithms that learn from dataā€”has grown into a foundational capability across industries. From voice assistants and recommendation systems to fraud detection and predictive healthcare, machine learning underpins countless innovations shaping daily life. In the UK, demand for ML professionals has surged. Financial services, healthcare providers, retailers, and tech start-ups are investing heavily in ML talent. Roles like Machine Learning Engineer, Data Scientist, and AI Researcher are among the most sought-after and best-paid in the tech sector. Yet we are still only at the start. Advances in generative AI, quantum computing, edge intelligence, and ethical governance are reshaping the field. Many of the most critical machine learning jobs of the next 10ā€“20 years donā€™t exist yet. This article explores why new careers will emerge, the kinds of roles likely to appear, how todayā€™s jobs will evolve, why the UK is well positioned, and how professionals can prepare.

Jobs

Seasonal Hiring Peaks for Machine Learning Jobs: The Best Months to Apply & Why

The UK's machine learning sector has evolved into one of Europe's most intellectually stimulating and financially rewarding technology markets, with roles spanning from junior ML engineers to principal machine learning scientists and heads of artificial intelligence research. With machine learning positions commanding salaries from Ā£32,000 for graduate ML engineers to Ā£160,000+ for senior principal scientists, understanding when organisations actively recruit can dramatically accelerate your career progression in this pioneering and rapidly evolving field. Unlike traditional software engineering roles, machine learning hiring follows distinct patterns influenced by AI research cycles, model development timelines, and algorithmic innovation schedules. The sector's unique combination of mathematical rigour, computational complexity, and real-world application requirements creates predictable hiring windows that strategic professionals can leverage to advance their careers in developing tomorrow's intelligent systems. This comprehensive guide explores the optimal timing for machine learning job applications in the UK, examining how enterprise AI strategies, academic research cycles, and deep learning initiatives influence recruitment patterns, and why strategic timing can determine whether you join a groundbreaking AI research team or miss the opportunity to develop the next generation of machine learning algorithms.

Jobs

Pre-Employment Checks for Machine Learning Jobs: DBS, References & Right-to-Work and more Explained

Pre-employment screening in machine learning reflects the discipline's unique position at the intersection of artificial intelligence research, algorithmic decision-making, and transformative business automation. Machine learning professionals often have privileged access to proprietary datasets, cutting-edge algorithms, and strategic AI systems that form the foundation of organizational competitive advantage and automated decision-making capabilities. The machine learning industry operates within complex regulatory frameworks spanning AI governance directives, algorithmic accountability requirements, and emerging ML ethics regulations. Machine learning specialists must demonstrate not only technical competence in model development and deployment but also deep understanding of algorithmic fairness, AI safety principles, and the societal implications of automated decision-making at scale. Modern machine learning roles frequently involve developing systems that impact hiring decisions, financial services, healthcare diagnostics, and autonomous operations across multiple regulatory jurisdictions and ethical frameworks simultaneously. The combination of algorithmic influence, predictive capabilities, and automated decision-making authority makes thorough candidate verification essential for maintaining compliance, fairness, and public trust in AI-powered systems.

šŸŖ We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.