Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Azure Data Engineer

Derby
9 months ago
Applications closed

Related Jobs

View all jobs

Azure Data Engineer - Manchester

Azure Data Engineer - Manchester

Azure Data Engineer - Fabric

Azure & Snowflake Data Engineer

Senior Azure Data Engineer

Lead Azure Data engineer

£55,000 (+ bonus opportunity, up to 10%)
Full Time - Permanent
Hybrid Working - 1 day in office every 1 - 2 weeks (Derby)

The Client
The client has been at the heart of the UK rail network for three decades and owns around a quarter of the national passenger rail fleet.
They mobilise private finance to drive rail growth through tailored leasing solutions, industry leading innovations and essential network projects that deliver a safe, efficient and sustainable railway.
Their mission is to provide high-quality, digitally enabled rolling stock solutions that help deliver a safe, efficient and sustainable railway. We take an industry-leading approach, driven by innovative thinking and future planning.
About the team
The successful candidate will be joining the Fleet function, a small multi-disciplinary team that supports corporate and project governance, risk management and audits of Train Operating Companies, suppliers and internal processes. The team is part of the Operations Directorate reporting to the Chief Operating Officer

Responsibilities
This role will support the delivery and development of the client's Digital Portfolio. Taking advantage of the client's unified data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner

  • Monitoring and recovery of Azure Data Factory and Databricks jobs
  • Proactive monitoring of data quality
  • Becoming a subject matter expert on understanding client's data sources, ingestion methods and data quality levels
  • Assisting in developing and adhering to associated data governance policies and internal processes
  • Working closely with the wider team to understand the business needs and improve data quality
  • Develop and maintain digital services data quality KPIs
  • Maintaining and monitoring of user facing dashboards and other internal Digital products
  • Updating and patching of existing Digital software products
  • Documenting root cause analysis outputs
  • Skills, Knowledge and Expertise
    Role Requirements
  • Microsoft Azure Experience (essential)
  • Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
  • Strong Python and SQL skills for manipulating data
  • Apache Spark and/or Databricks experience
  • Experience using BI visualisation tools, such as Power BI
  • Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
  • Experience in root-cause analysis and post-incident reporting in a production environment

    Knowledge and Qualifications
  • A relevant degree in Computer Science, Engineering, and/or relevant certificates including, Azure Data Engineer Associate are desirable
  • Knowledge of railway industry rolling stock, organisation and players
  • Data ingestion methods for real-time and batch ingestion
  • PySpark
  • Debugging Apache Spark workloads
  • Experience using BI visualisation tools, such as Power BI
    Key Skills
  • Interpersonal skills
  • Report writing, presentation and record keeping skills
  • Excellent communication and stakeholder management
  • A great place to work
  • We are seeking the very best talent to join the team, and offer an excellent salary, along with bonus and benefits
    This is a fantastic opportunity to join a great organisation with excellent people and a road map for the future to grow and develop the business. Some of our benefits are listed below:
  • Excellent pension scheme
  • Financial wellbeing support
  • Flexible working
  • Enhanced family friendly policies
  • Adoption & Shared Parental Leave benefits
  • Enhanced Armed Forces policies
  • Ongoing support with professional and personal development
  • Long service awards
  • Life assurance
  • Healthcare cash plan
  • 25 days' annual leave + Bank Holidays + option to buy and sell up to 5 days' additional leave
  • Additional days annual leave for long service
  • Season ticket loan
  • Cycle to work scheme

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Best Free Tools & Platforms to Practise Machine Learning Skills in 2025/26

Machine learning (ML) has become one of the most in-demand career paths in technology. From predicting customer behaviour in retail to detecting fraud in banking and enabling medical breakthroughs in healthcare, ML is transforming industries across the UK and beyond. But here’s the truth: employers don’t just want candidates who have read about machine learning in textbooks. They want evidence that you can actually build, train, and deploy models. That means practising with real tools, working with real datasets, and solving real problems. The good news is that you don’t need to pay for expensive software or courses to get started. A wide range of free, open-source tools and platforms allow you to learn machine learning skills hands-on. Whether you’re a beginner or preparing for advanced roles, you can practise everything from simple linear regression to deploying deep learning models — at no cost. In this guide, we’ll explore the best free tools and platforms to practise machine learning skills in 2025, and how to use them effectively to build a portfolio that UK employers will notice.

Top 10 Skills in Machine Learning According to LinkedIn & Indeed Job Postings

Machine learning (ML) is at the forefront of innovation, powering systems in finance, healthcare, retail, logistics, and beyond in the UK. As organisations leverage ML for predictive analytics, automation, and intelligent systems, demand for skilled practitioners continues to grow. So, which skills are most in demand? Drawing on insights from LinkedIn and Indeed, this article outlines the Top 10 machine learning skills UK employers are looking for in 2025. You'll learn how to demonstrate these capabilities through your CV, interviews, and real-world projects.

The Future of Machine Learning Jobs: Careers That Don’t Exist Yet

Machine learning (ML) has become one of the most powerful forces reshaping the modern world. From voice assistants and recommendation engines to fraud detection and medical imaging, it underpins countless applications. ML is no longer confined to research labs—it powers business models, public services, and consumer technologies across the globe. In the UK, demand for machine learning professionals has risen dramatically. Organisations in finance, retail, healthcare, and defence are embedding ML into their operations. Start-ups in Cambridge, London, and Edinburgh are pioneering innovations, while government-backed initiatives aim to position the UK as a global AI leader. Salaries for ML engineers and researchers are among the highest in the tech sector. Yet despite its current importance, machine learning is only at the beginning of its journey. Advances in generative AI, quantum computing, robotics, and ethical governance will reshape the profession. Many of the most vital machine learning jobs of the next two decades don’t exist today. This article explores why new careers will emerge, the roles likely to appear, how today’s roles will evolve, why the UK is well positioned, and how professionals can prepare now.