Data Engineer (AI-Driven Pipelines & Research)

Arrow Global Group
Manchester
1 week ago
Create job alert

Description

OurData Engineerwill help to build and scale the data infrastructure that powers our AI products. This role is hands-on and technically deep — ideal for someone who cares about data quality, robustness, and automation. Working closely with AI engineers to design pipelines that do more than move data — they clean, enrich, and understand it, increasingly using large language models and agents to automate complex steps in the process. 


About the Team

This role will be part of a team that isflat-structured, best-idea-wins cultureandwhere engineers shape product direction. We operate a supportive culture that values ownership as we want people who take responsibility but aren’t afraid to ask for help where needed. Whilst our offices and extend teams are based in Manchester and London, we also offer flexibility to work from anywhere(UK)for this role — though we’re Europe-focused and love getting together for hackathons and team problem-solving when it matters. 


About the role


  •  Building and maintaining data pipelines in Python, with a focus on reliability, transparency, and scale. 
  • Using LLMs to assist with data cleansing, enrichment, classification, and contextual tagging.
  • Experimenting with AI agents to automate complex research tasks and structured data extraction. 
  • Working with product and AI engineering teams to feed trustworthy data into fast-moving prototypes.
  • Designing workflows that transform noisy, semi-structured data into actionable insight.
  • Supporting experimentation and iteration — shipping fast and learning from what works. 


What we're looking for & more


  •  Strong proficiency in Python and pandas (or Polars), and a track record of delivering working data systems. 
  • Experience with common data formats (JSON, XML, CSV) and transforming unstructured data. 
  • Familiarity with modern cloud-native tooling (we use AWS — especially Lambda and Step Functions). 
  • Interest or experience in using LLMs for tasks like data enrichment or transformation. 
  • A mindset that treats pipelines as products — robust, debuggable, and always improving.
  • Curiosity about how AI can go beyond the model — helping automate research and discovery. 
It would be beneficial(not essential)if you have experience with tools like LangChain, Haystack, Pandas AI, or vector databases as well as any prior projects involving agents for data understanding or research automation.



Sound like you? Great!Whilst a CV tells us part of your story, we would love to see a short summary about you with any relevant links to Loom - following this we will reach out to you for a teams interview if suitable.

Whilst this position can be done from anywhere in the UK,you must already hold the relevant right to work in the UKas we unfortunately can't provide sponsorship for the role.
Great talent comes in many forms, and we’re committed to building a diverse and inclusive team. Whilst a number of our roles do require specific qualifications and experience, and industry knowledge, we also value potential, unique perspectives, and transferable skills. If you’re excited about this opportunity but don’t meet every requirement, we’d still love to hear from you. 

 We occasionally collaborate with recruitment agencies to fill niche or specialist roles. However, we do not accept agency terms or pay fees for speculative CVs submitted directly to our hiring managers or outside our Applicant Tracking System.
 
If you are a recruitment agency interested in partnering with us for candidate supply, please reach out to






Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Veterans in Machine Learning: A Military‑to‑Civilian Pathway into AI Careers

Introduction Artificial intelligence is no longer relegated to sci‑fi films—it underpins battlefield decision‑support, fraud detection, and even supermarket logistics. The UK Government’s 2025 AI Sector Deal forecasts an additional £200 billion in GDP by 2030, with machine‑learning (ML) engineers cited as the nation’s second most in‑demand tech role (Tech Nation 2024). The Ministry of Defence’s Defence AI Strategy echoes that urgency, earmarking £1.6 billion for FY 2025–28 to embed ML into planning, logistics, and autonomous systems. If you have ever tuned a radar filter, plotted artillery trajectories, or sifted sensor data for actionable intel, you have already worked with statistical modelling—the backbone of machine learning. This guide shows UK veterans how to reframe military experience for ML roles, leverage MoD transition funding, and land high‑impact positions building the models shaping tomorrow’s defence and commercial landscapes. Quick Win: Bookmark our live board for Machine‑Learning Engineer roles to see who’s hiring today.

Rural-Remote Machine Learning Jobs: Finding Balance Beyond the Big Cities

Over the past decade, machine learning (ML) has transformed from a niche research domain into a pervasive technology underpinning everything from recommendation systems and voice assistants to financial forecasting and autonomous vehicles. Historically, the UK’s major tech hubs—particularly London—have been magnets for top ML talent and corporate headquarters. However, remote work has become mainstream, and many ML professionals are realising they can excel in their field while living far beyond the city limits. At MachineLearningJobs.co.uk, we’ve observed a growing interest in positions that allow for a rural lifestyle or a coastal environment, often reflected in search terms like “ML remote countryside” or “tech jobs by the sea.” This surge is no coincidence. Flexible work policies, better rural broadband, and the nature of machine learning tasks—much of which can be done through cloud platforms—are bringing new opportunities to those who wish to swap urban hustle for fresh air and scenic views. Whether you’re a data scientist, ML engineer, researcher, or product manager, a rural or seaside move could reinvigorate your work-life balance. In this article, we’ll unpack why rural-remote ML jobs are on the rise, how you can navigate the challenges of leaving the city, and what you need to do to thrive in a machine learning career beyond the M25. If you’ve dreamt of looking up from your laptop to rolling fields or ocean waves, keep reading—your rural ML role might be closer than you think.

Quantum-Enhanced Machine Learning—Propelling AI into the Next Frontier

Machine learning (ML) has revolutionised how we interpret data, build predictive models, and create intelligent applications. From recommendation engines and self-driving cars to advanced genomics and natural language processing, ML solutions are integral to nearly every corner of modern life. However, as data complexity and model size continue to skyrocket, the computational demands placed on ML systems grow in tandem—often pushing even high-performance classical computers to their limits. In recent years, quantum computing has emerged as a tantalising solution to these challenges. Unlike traditional digital systems, quantum computers exploit quantum mechanics—superposition and entanglement—to process information in ways that defy conventional logic. As these machines mature, they promise exponential speed-ups for certain tasks, potentially reshaping how we approach AI and data-intensive challenges. What does this mean for machine learning? Enter quantum-enhanced ML, a new frontier where quantum processors and classical ML frameworks unite to accelerate model training, tackle high-dimensional data, and solve complex optimisation tasks more efficiently. In this article, we will: Unpack the current state of machine learning, highlighting key bottlenecks. Provide a concise overview of quantum computing—why it’s radical and how it differs from classical technology. Examine potential breakthroughs in quantum-enhanced ML, including real-world use cases and technical approaches. Explore the roles and skill sets that will define this quantum-AI era, with guidance on how to prepare. Discuss the roadblocks (like hardware maturity and ethical concerns) and how they might be addressed in the years to come. If you’re a machine learning engineer, data scientist, or simply an AI enthusiast fascinated by the next wave of computational innovation, read on—quantum computing could become an integral part of your future toolkit, opening up job opportunities and reimagining what ML can achieve.