Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data Engineer

AI Connect
Glasgow
4 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer, Glasgow (Remote Working)


Day Rate:£450 Per Day

Duration:3 months(extension possible)

IR35 Status:Outside IR35


Overview

We are seeking an experiencedData Engineer Contractorto deliver a robust, scalable data integration pipeline on the Azure platform. This role requires hands-on expertise in API ingestion, orchestration, and transformation into a well-designed data warehouse structure, includingstar schema designfor downstream analytics.

You’ll play a key role in building end-to-end data flow from source APIs to a SQL-based DWH, ensuring data is clean, reliable, and analytics-ready.


Key Responsibilities

  • DevelopPython-based ETL scriptsto extract data from external REST APIs
  • Implementincremental loadingstrategies using watermarking or change detection
  • Orchestrate workflows usingAzure Function Appsor Docker containers
  • Integrate processes intoAzure Data Factory (ADF)pipelines
  • Design and implementstar schemassuitable for reporting and analytics use cases
  • Write and optimizeT-SQL stored proceduresfor transformation
  • Establishmonitoring, logging, and alertingfor pipeline reliability
  • Contribute toCI/CD pipelinesfor deployment automation
  • Maintain clear and concisetechnical documentationthroughout



Essential Skills & Experience

  • AdvancedPythonskills for building data extraction and transformation workflows
  • Solid experience acrossAzure data services, particularly:
  • Azure Function Appsor Docker
  • Azure Data Factory (ADF)
  • Azure SQL / Synapse
  • Strong experience indesigning star schemasand dimensional modelling for analytics
  • Strong SQL development skills (stored procedures, indexing, performance tuning)
  • Experience withincremental data loading patterns(e.g. watermarking)
  • Proven ability to build and supportreliable, production-grade data pipelines
  • Working knowledge ofCI/CD tools(e.g. Azure DevOps, Git)

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Why the UK Could Be the World’s Next Machine Learning Jobs Hub

Machine learning (ML) is becoming essential to industries across the globe—from finance and healthcare to retail, logistics, defence, and the public sector. Its ability to uncover patterns in data, make predictions, drive automation, and increase operational efficiency has made it one of the most in-demand skill sets in the technology world. In the UK, machine learning roles—from engineers to researchers, product managers to analysts—are increasingly central to innovation. Universities are expanding ML programmes, enterprises are scaling ML deployments, and startups are offering applied ML solutions. All signs point toward a surging need for professionals skilled in modelling, algorithms, data pipelines, and AI systems. This article explores why the United Kingdom is exceptionally well positioned to become a global machine learning jobs hub. It examines the current landscape, strengths, career paths, sector-specific demand, challenges, and what must happen for this vision to become reality.

The Best Free Tools & Platforms to Practise Machine Learning Skills in 2025/26

Machine learning (ML) has become one of the most in-demand career paths in technology. From predicting customer behaviour in retail to detecting fraud in banking and enabling medical breakthroughs in healthcare, ML is transforming industries across the UK and beyond. But here’s the truth: employers don’t just want candidates who have read about machine learning in textbooks. They want evidence that you can actually build, train, and deploy models. That means practising with real tools, working with real datasets, and solving real problems. The good news is that you don’t need to pay for expensive software or courses to get started. A wide range of free, open-source tools and platforms allow you to learn machine learning skills hands-on. Whether you’re a beginner or preparing for advanced roles, you can practise everything from simple linear regression to deploying deep learning models — at no cost. In this guide, we’ll explore the best free tools and platforms to practise machine learning skills in 2025, and how to use them effectively to build a portfolio that UK employers will notice.

Top 10 Skills in Machine Learning According to LinkedIn & Indeed Job Postings

Machine learning (ML) is at the forefront of innovation, powering systems in finance, healthcare, retail, logistics, and beyond in the UK. As organisations leverage ML for predictive analytics, automation, and intelligent systems, demand for skilled practitioners continues to grow. So, which skills are most in demand? Drawing on insights from LinkedIn and Indeed, this article outlines the Top 10 machine learning skills UK employers are looking for in 2025. You'll learn how to demonstrate these capabilities through your CV, interviews, and real-world projects.