Data Engineer (AI and Automation)

Network IT Recruitment Limited
Milton Keynes
3 days ago
Create job alert

Location: Milton Keynes (Hybrid – 3 Days In-Office Weekly)

Network IT are partnering with a large, enterprise‑scale organisation undergoing significant modernisation of their data and automation platforms. We’re seeking an experienced Data Automation Engineer to design, build, and optimise secure, highly automated data pipelines that enable scalable analytics, AI‑ready data, and intelligent, data‑driven operations across the business.

This role is suited to someone with hands‑on experience delivering robust end‑to‑end data solutions, strong automation capability, and growing exposure to AI‑enabled data workflows, including opportunities to influence how LLMs and AI automation are embedded into the organisation’s data estate.

Role Overview and Responsibilities

As a Data Automation Engineer, you will take ownership of the delivery, operation, and continuous improvement of automated data pipelines and platform components across Azure and on‑prem environments. You’ll work closely with Data Engineers, Solution Architects, Application Managers, and international teams to ensure data operations are scalable, resilient, and aligned with governance and quality standards.

Key responsibilities include:

  • Designing, building, and maintaining fully automated end‑to‑end data pipelines, ensuring secure, reliable data ingestion, transformation, delivery, and documentation.
  • Delivering high‑quality data flows using tools such as Azure Data Factory, Databricks, SQL, and Python, reducing manual intervention through standardisation and automation.
  • Identifying and implementing improvements in speed, reliability, and scalability, including opportunities to apply AI‑supported automation and optimisation.
  • Preparing and maintaining high‑quality datasets and AI‑ready data models (DWH / Lakehouse) to support analytics, reporting, and machine‑learning use cases.
  • Monitoring and troubleshooting daily data operations, resolving issues following ITIL best practices, and implementing proactive improvements, alerting, and self‑healing mechanisms.
  • Enhancing pipeline performance and observability, improving monitoring, alerting, and automated preventative rules.
  • Supporting data governance processes such as data quality, lineage, masking, encryption, archiving, and compliance, with increasing automation maturity.
  • Contributing to CI/CD processes, orchestration, scheduling, and platform‑level enhancements to support scalable, AI‑enabled data foundations.
  • Collaborating with cross‑functional and international teams to align changes, share best practices, and support the execution of the organisation’s data strategy.

Essential Skills and Experience

To be successful in this role, you will bring:

  • Proven experience delivering automated end‑to‑end data engineering solutions in complex environments.
  • Advanced SQL skills, including performance tuning and optimised queries across large datasets to prepare AI‑ready data.
  • Knowledge of Python (or R) for data processing, transformation, or analytics.
  • Hands‑on experience with cloud and on‑prem data integration tools such as Azure Data Factory and Databricks.
  • Strong background in data modelling, data warehousing, and relational database environments (e.g., MS SQL Server).
  • Experience designing cloud‑native and on‑prem data solutions.
  • Exposure to AI/ML initiatives, AI‑enabled automation, and an understanding of LLM concepts and their data workflow applications.
  • Experience working in Agile environments (Scrum, Kanban, DevOps).
  • Strong analytical, problem‑solving, and communication skills, with the ability to work effectively across technical and non‑technical teams.


#J-18808-Ljbffr

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

New Machine Learning Employers to Watch in 2026: UK and Global Companies Driving ML Innovation

Machine learning (ML) has transitioned from a specialised field into a core business capability. In 2026, organisations across healthcare, finance, robotics, autonomous systems, natural language processing, and analytics are expanding their machine learning teams to build scalable intelligent products and services. For professionals exploring opportunities on www.MachineLearningJobs.co.uk , understanding the companies that are scaling, winning investment, or securing high‑impact contracts is crucial. This article highlights the new and high‑growth machine learning employers to watch in 2026, focusing on UK innovators, international firms with significant UK presence, and global platforms investing in machine learning talent locally.

How Many Machine Learning Tools Do You Need to Know to Get a Machine Learning Job?

Machine learning is one of the most exciting and rapidly growing areas of tech. But for job seekers it can also feel like a maze of tools, frameworks and platforms. One job advert wants TensorFlow and Keras. Another mentions PyTorch, scikit-learn and Spark. A third lists Mlflow, Docker, Kubernetes and more. With so many names out there, it’s easy to fall into the trap of thinking you must learn everything just to be competitive. Here’s the honest truth most machine learning hiring managers won’t say out loud: 👉 They don’t hire you because you know every tool. They hire you because you can solve real problems with the tools you know. Tools are important — no doubt — but context, judgement and outcomes matter far more. So how many machine learning tools do you actually need to know to get a job? For most job seekers, the real number is far smaller than you think — and more logically grouped. This guide breaks down exactly what employers expect, which tools are core, which are role-specific, and how to structure your learning for real career results.

What Hiring Managers Look for First in Machine Learning Job Applications (UK Guide)

Whether you’re applying for machine learning engineer, applied scientist, research scientist, ML Ops or data scientist roles, hiring managers scan applications quickly — often making decisions before they’ve read beyond the top third of your CV. In the competitive UK market, it’s not enough to list skills. You must send clear signals of relevance, delivery, impact, reasoning and readiness for production — and do it within the first few lines of your CV or portfolio. This guide walks you through exactly what hiring managers look for first in machine learning applications, how they evaluate CVs and portfolios, and what you can do to improve your chances of getting shortlisted at every stage — from your CV and LinkedIn profile to your cover letter and project portfolio.