Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Associate Director, IT, Data Engineering Technical Lead (Databricks)

MUFG Investor Services
City of London
3 days ago
Create job alert
Senior Associate Director, IT, Data Engineering Technical Lead (Databricks)

We are seeking a highly skilled Data Engineer with strong Databricks expertise to join our dynamic data engineering team. Your primary focus will be to design, develop, and optimize data pipelines and workflows leveraging Databricks on AWS infrastructure.


Why Join Us?

  • Be part of a skilled team driving innovative solutions using Databricks and AWS.
  • Opportunities to directly impact and shape the strategic direction of our data platform.
  • Competitive compensation with significant professional growth opportunities.

You Will

  • Develop and maintain high-performance data pipelines using Databricks and Spark
  • Collaborate with architects and analysts to build data models and transformations
  • Ensure data quality, security, and compliance within Databricks environments
  • Implement monitoring and logging strategies to ensure data pipeline reliability and performance
  • Deploy and manage code via CI/CD workflows
  • Troubleshoot and resolve complex data processing challenges efficiently

Qualifications
Skills & Qualifications

  • A Bachelor’s degree in Computer Science or a related technical field or equivalent experience
  • 10+ years of experience in Data Engineering
  • 5-10 years of commercial experience with modern data stack i.e. Databricks, Snowflake or similar
  • Proficient in programming with Python and SQL
  • Expert-level proficiency in Databricks, including PySpark, Spark SQL, and Delta Lake
  • Strong experience with data modeling, optimization, and performance tuning within Databricks
  • Hands-on experience with AWS infrastructure, specifically for Databricks deployments
  • Solid understanding of data governance, security best practices, and compliance
  • Familiarity with CI/CD principles and practices
  • Excellent problem-solving skills and ability to collaborate effectively in agile teams

Preferred

  • Prior experience working within financial services or highly regulated environments

Additional Information

What’s in it for you to join MUFG Investor Services?


Take a look at our careers site and you’ll find everything you’d expect working with one of the fastest-growing businesses at one of the world’s largest financial groups. Now take another look. Because it’s how we defy expectations that really defines us. You’ll feel that difference in all kinds of ways. Our vibrant CULTURE. Connected team. Love of innovation, laser client focus.


So, why settle for the ordinary? Apply now for your next Brilliantly Different opportunity.


We thank all candidates for applying; however, only those proceeding to the interview stage will be contacted.


MUFG is an equal opportunity employer


Details

  • Seniority level: Mid-Senior level
  • Employment type: Full-time
  • Job function: Information Technology

Referrals increase your chances of interviewing at MUFG Investor Services by 2x


Get notified about new Associate Director of Information Technology jobs in London, England, United Kingdom.



#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Scientist (UK)

Senior Consultant or Manager, IT Asset Management / Process Engineer / Data Analyst, Cyber, Exten...

Associate Director Data Science

Associate Director, AI Data Scientist

Senior Data Scientist (UK)

Senior Machine Learning Engineer (UK)

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Machine Learning Recruitment Trends 2025 (UK): What Job Seekers Need To Know About Today’s Hiring Process

Summary: UK machine learning hiring has shifted from title‑led CV screens to capability‑driven assessments that emphasise shipped ML/LLM features, robust evaluation, observability, safety/governance, cost control and measurable business impact. This guide explains what’s changed, what to expect in interviews & how to prepare—especially for ML engineers, applied scientists, LLM application engineers, ML platform/MLOps engineers and AI product managers. Who this is for: ML engineers, applied ML/LLM engineers, LLM/retrieval engineers, ML platform/MLOps/SRE, data scientists transitioning to production ML, AI product managers & tech‑lead candidates targeting roles in the UK.

Why Machine Learning Careers in the UK Are Becoming More Multidisciplinary

Machine learning (ML) has moved from research labs into mainstream UK businesses. From healthcare diagnostics to fraud detection, autonomous vehicles to recommendation engines, ML underpins critical services and consumer experiences. But the skillset required of today’s machine learning professionals is no longer purely technical. Employers increasingly seek multidisciplinary expertise: not only coding, algorithms & statistics, but also knowledge of law, ethics, psychology, linguistics & design. This article explores why UK machine learning careers are becoming more multidisciplinary, how these fields intersect with ML roles, and what both job-seekers & employers need to understand to succeed in a rapidly changing landscape.

Machine Learning Team Structures Explained: Who Does What in a Modern Machine Learning Department

Machine learning is now central to many advanced data-driven products and services across the UK. Whether you work in finance, healthcare, retail, autonomous vehicles, recommendation systems, robotics, or consumer applications, there’s a need for dedicated machine learning teams that can deliver models into production, maintain them, keep them secure, efficient, fair, and aligned with business objectives. If you’re hiring for or applying to ML roles via MachineLearningJobs.co.uk, this article will help you understand what roles are typically present in a mature machine learning department, how they collaborate through project lifecycles, what skills and qualifications UK employers look for, what the career paths and salaries are, current trends and challenges, and how to build an effective ML team.