Data Engineer

AI Connect
Glasgow
3 weeks ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer SAP {Defence, MoD

Data Engineer, Glasgow (Remote Working)


Day Rate:£450 Per Day

Duration:3 months(extension possible)

IR35 Status:Outside IR35


Overview

We are seeking an experiencedData Engineer Contractorto deliver a robust, scalable data integration pipeline on the Azure platform. This role requires hands-on expertise in API ingestion, orchestration, and transformation into a well-designed data warehouse structure, includingstar schema designfor downstream analytics.

You’ll play a key role in building end-to-end data flow from source APIs to a SQL-based DWH, ensuring data is clean, reliable, and analytics-ready.


Key Responsibilities

  • DevelopPython-based ETL scriptsto extract data from external REST APIs
  • Implementincremental loadingstrategies using watermarking or change detection
  • Orchestrate workflows usingAzure Function Appsor Docker containers
  • Integrate processes intoAzure Data Factory (ADF)pipelines
  • Design and implementstar schemassuitable for reporting and analytics use cases
  • Write and optimizeT-SQL stored proceduresfor transformation
  • Establishmonitoring, logging, and alertingfor pipeline reliability
  • Contribute toCI/CD pipelinesfor deployment automation
  • Maintain clear and concisetechnical documentationthroughout



Essential Skills & Experience

  • AdvancedPythonskills for building data extraction and transformation workflows
  • Solid experience acrossAzure data services, particularly:
  • Azure Function Appsor Docker
  • Azure Data Factory (ADF)
  • Azure SQL / Synapse
  • Strong experience indesigning star schemasand dimensional modelling for analytics
  • Strong SQL development skills (stored procedures, indexing, performance tuning)
  • Experience withincremental data loading patterns(e.g. watermarking)
  • Proven ability to build and supportreliable, production-grade data pipelines
  • Working knowledge ofCI/CD tools(e.g. Azure DevOps, Git)

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers Education

Top 10 Best UK Universities for Machine Learning Degrees (2025 Guide)

Explore ten UK universities that deliver world-class machine-learning degrees in 2025. Compare entry requirements, course content, research strength and industry links to find the programme that fits your goals. Machine learning (ML) has shifted from academic curiosity to the engine powering everything from personalised medicine to autonomous vehicles. UK universities have long been pioneers in the field, and their programmes now blend rigorous theory with hands-on practice on industrial-scale datasets. Below, we highlight ten institutions whose undergraduate or postgraduate pathways focus squarely on machine learning. League tables move each year, but these universities consistently excel in teaching, research and collaboration with industry.

Jobs

How to Write a Winning Cover Letter for Machine Learning Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for machine learning jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the machine learning sector. When applying for a machine learning job, your cover letter is a vital part of your application. Machine learning is an exciting and rapidly evolving field, and your cover letter offers the chance to demonstrate your technical expertise, passion for AI, and your ability to apply machine learning techniques to solve real-world problems. Writing a cover letter for machine learning roles may feel intimidating, but by following a clear structure, you can showcase your strengths effectively. Whether you're just entering the field, transitioning from another role, or looking to advance your career in machine learning, this article will guide you through a proven four-paragraph structure. We’ll provide practical tips and sample lines to help you create a compelling cover letter that catches the attention of hiring managers in the machine learning job market.

Jobs Careers

Veterans in Machine Learning: A Military‑to‑Civilian Pathway into AI Careers

Introduction Artificial intelligence is no longer relegated to sci‑fi films—it underpins battlefield decision‑support, fraud detection, and even supermarket logistics. The UK Government’s 2025 AI Sector Deal forecasts an additional £200 billion in GDP by 2030, with machine‑learning (ML) engineers cited as the nation’s second most in‑demand tech role (Tech Nation 2024). The Ministry of Defence’s Defence AI Strategy echoes that urgency, earmarking £1.6 billion for FY 2025–28 to embed ML into planning, logistics, and autonomous systems. If you have ever tuned a radar filter, plotted artillery trajectories, or sifted sensor data for actionable intel, you have already worked with statistical modelling—the backbone of machine learning. This guide shows UK veterans how to reframe military experience for ML roles, leverage MoD transition funding, and land high‑impact positions building the models shaping tomorrow’s defence and commercial landscapes. Quick Win: Bookmark our live board for Machine‑Learning Engineer roles to see who’s hiring today.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.