Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer - Databricks (6 Month Contractor)

MUFG Investor Services
London
1 week ago
Create job alert

Job Description

We are looking for a skilled Data Engineer with substantial experience to design, develop, and maintain scalable data pipelines and data solutions using Databricks. You'll collaborate closely with cross-functional teams to ensure data quality, availability, and efficiency to support analytics and business intelligence.

You Will:

  • Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark
  • Develop and maintain complex ETL/ELT pipelines processing terabytes of data daily
  • Architect medallion architecture (Bronze, Silver, Gold) data lakehouses with optimal performance patterns
  • Implement real-time and batch data processing solutions using Structured Streaming and Delta Live Tables
  • Design data mesh architectures with proper data governance and lineage tracking
  • Optimize Spark jobs for cost efficiency and performance, including cluster auto-scaling and resource management
  • Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering
  • Build robust data quality frameworks with automated testing and monitoring
  • Design and implement CI/CD pipelines for data workflows using Databricks Asset Bundles or similar tools
  • Develop custom solutions using Databricks APIs and integrate with external systems

#LI-Hybrid


Qualifications

You Have:

  • A Bachelor’s degree in computer science, or a related field.
  • 10+ years of experience in data engineering, including designing and deploying production-quality data pipelines and ETL/ELT solutions.
  • A Databricks Certified Professional Data Engineer certification
  • Proficiency in Python, PySpark and SQL.
  • Strong hands-on experience with cloud services such as AWS (Glue, Lambda, Redshift, S3).
  • Experience with data governance and management platforms (e.g., AWS Sagemaker Unified Studio and Unity Catalog.
  • Experience with data migration projects and legacy system modernization
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes) is a plus.



Additional Information

What’s in it for you to join MUFG Investor Services? 

Take a look at our careers site and you’ll find everything you’d expect working with one of the fastest-growing businesses at one of the world’s largest financial groups. Now take another look. Because it’s how we defy expectations that really defines us. You’ll feel that difference in all kinds of ways.  Our vibrant CULTURE. Connected team. Love of innovation, laser client focus. 

So, why settle for the ordinary?  Apply now for your next Brilliantly Different opportunity. 

We thank all candidates for applying; however, only those proceeding to the interview stage will be contacted.

MUFG is an equal opportunity employer

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Best Free Tools & Platforms to Practise Machine Learning Skills in 2025/26

Machine learning (ML) has become one of the most in-demand career paths in technology. From predicting customer behaviour in retail to detecting fraud in banking and enabling medical breakthroughs in healthcare, ML is transforming industries across the UK and beyond. But here’s the truth: employers don’t just want candidates who have read about machine learning in textbooks. They want evidence that you can actually build, train, and deploy models. That means practising with real tools, working with real datasets, and solving real problems. The good news is that you don’t need to pay for expensive software or courses to get started. A wide range of free, open-source tools and platforms allow you to learn machine learning skills hands-on. Whether you’re a beginner or preparing for advanced roles, you can practise everything from simple linear regression to deploying deep learning models — at no cost. In this guide, we’ll explore the best free tools and platforms to practise machine learning skills in 2025, and how to use them effectively to build a portfolio that UK employers will notice.

Top 10 Skills in Machine Learning According to LinkedIn & Indeed Job Postings

Machine learning (ML) is at the forefront of innovation, powering systems in finance, healthcare, retail, logistics, and beyond in the UK. As organisations leverage ML for predictive analytics, automation, and intelligent systems, demand for skilled practitioners continues to grow. So, which skills are most in demand? Drawing on insights from LinkedIn and Indeed, this article outlines the Top 10 machine learning skills UK employers are looking for in 2025. You'll learn how to demonstrate these capabilities through your CV, interviews, and real-world projects.

The Future of Machine Learning Jobs: Careers That Don’t Exist Yet

Machine learning (ML) has become one of the most powerful forces reshaping the modern world. From voice assistants and recommendation engines to fraud detection and medical imaging, it underpins countless applications. ML is no longer confined to research labs—it powers business models, public services, and consumer technologies across the globe. In the UK, demand for machine learning professionals has risen dramatically. Organisations in finance, retail, healthcare, and defence are embedding ML into their operations. Start-ups in Cambridge, London, and Edinburgh are pioneering innovations, while government-backed initiatives aim to position the UK as a global AI leader. Salaries for ML engineers and researchers are among the highest in the tech sector. Yet despite its current importance, machine learning is only at the beginning of its journey. Advances in generative AI, quantum computing, robotics, and ethical governance will reshape the profession. Many of the most vital machine learning jobs of the next two decades don’t exist today. This article explores why new careers will emerge, the roles likely to appear, how today’s roles will evolve, why the UK is well positioned, and how professionals can prepare now.