National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Azure Data Engineer

London
6 months ago
Applications closed

Related Jobs

View all jobs

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

£55,000 (+ bonus opportunity, up to 10%)
Full Time - Permanent
Hybrid Working - Location (Derby - London

The Client
The client has been at the heart of the UK rail network for three decades and owns around a quarter of the national passenger rail fleet.
They mobilise private finance to drive rail growth through tailored leasing solutions, industry leading innovations and essential network projects that deliver a safe, efficient and sustainable railway.
Their mission is to provide high-quality, digitally enabled rolling stock solutions that help deliver a safe, efficient and sustainable railway. We take an industry-leading approach, driven by innovative thinking and future planning.
About the team
The successful candidate will be joining the Fleet function, a small multi-disciplinary team that supports corporate and project governance, risk management and audits of Train Operating Companies, suppliers and internal processes. The team is part of the Operations Directorate reporting to the Chief Operating Officer
Responsibilities
This role will support the delivery and development of the client's Digital Portfolio. Taking advantage of the client's unified data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner

  • Monitoring and recovery of Azure Data Factory and Databricks jobs
  • Proactive monitoring of data quality
  • Becoming a subject matter expert on understanding client's data sources, ingestion methods and data quality levels
  • Assisting in developing and adhering to associated data governance policies and internal processes
  • Working closely with the wider team to understand the business needs and improve data quality
  • Develop and maintain digital services data quality KPIs
  • Maintaining and monitoring of user facing dashboards and other internal Digital products
  • Updating and patching of existing Digital software products
  • Documenting root cause analysis outputs
  • Skills, Knowledge and Expertise
    Role Requirements
  • Microsoft Azure Experience (essential)
  • Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
  • Strong Python and SQL skills for manipulating data
  • Apache Spark and/or Databricks experience
  • Experience using BI visualisation tools, such as Power BI
  • Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
  • Experience in root-cause analysis and post-incident reporting in a production environment
    Knowledge and Qualifications
  • A relevant degree in Computer Science, Engineering, and/or relevant certificates including, Azure Data Engineer Associate are desirable
  • Knowledge of railway industry rolling stock, organisation and players
  • Data ingestion methods for real-time and batch ingestion
  • PySpark
  • Debugging Apache Spark workloads
  • Experience using BI visualisation tools, such as Power BI
    Key Skills
  • Interpersonal skills
  • Report writing, presentation and record keeping skills
  • Excellent communication and stakeholder management
  • A great place to work
  • We are seeking the very best talent to join the team, and offer an excellent salary, along with bonus and benefits
    This is a fantastic opportunity to join a great organisation with excellent people and a road map for the future to grow and develop the business. Some of our benefits are listed below:
  • Excellent pension scheme
  • Financial wellbeing support
  • Flexible working
  • Enhanced family friendly policies
  • Adoption & Shared Parental Leave benefits
  • Enhanced Armed Forces policies
  • Ongoing support with professional and personal development
  • Long service awards
  • Life assurance
  • Healthcare cash plan
  • 25 days' annual leave + Bank Holidays + option to buy and sell up to 5 days' additional leave
  • Additional days annual leave for long service
  • Season ticket loan
  • Cycle to work scheme
National AI Awards 2025

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Mistakes Candidates Make When Applying for Machine-Learning Jobs—And How to Avoid Them

Landing a machine-learning job in the UK is competitive. Learn the 10 biggest mistakes applicants make—plus tested fixes, expert resources and live links that will help you secure your next ML role. Introduction From fintechs in London’s Square Mile to advanced-research hubs in Cambridge, demand for machine-learning talent is exploding. Job boards such as MachineLearningJobs.co.uk list new vacancies daily, and LinkedIn shows more than 10,000 open ML roles across the UK right now. Yet hiring managers still reject most CVs long before interview—often for avoidable errors. Below are the ten most common mistakes we see, each paired with a practical fix and a live resource link so you can dive deeper.

Top 10 Best UK Universities for Machine Learning Degrees (2025 Guide)

Explore ten UK universities that deliver world-class machine-learning degrees in 2025. Compare entry requirements, course content, research strength and industry links to find the programme that fits your goals. Machine learning (ML) has shifted from academic curiosity to the engine powering everything from personalised medicine to autonomous vehicles. UK universities have long been pioneers in the field, and their programmes now blend rigorous theory with hands-on practice on industrial-scale datasets. Below, we highlight ten institutions whose undergraduate or postgraduate pathways focus squarely on machine learning. League tables move each year, but these universities consistently excel in teaching, research and collaboration with industry.

How to Write a Winning Cover Letter for Machine Learning Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for machine learning jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the machine learning sector. When applying for a machine learning job, your cover letter is a vital part of your application. Machine learning is an exciting and rapidly evolving field, and your cover letter offers the chance to demonstrate your technical expertise, passion for AI, and your ability to apply machine learning techniques to solve real-world problems. Writing a cover letter for machine learning roles may feel intimidating, but by following a clear structure, you can showcase your strengths effectively. Whether you're just entering the field, transitioning from another role, or looking to advance your career in machine learning, this article will guide you through a proven four-paragraph structure. We’ll provide practical tips and sample lines to help you create a compelling cover letter that catches the attention of hiring managers in the machine learning job market.