PySpark Developer Manager

McGregor Boyall
London
2 weeks ago
Applications closed

Related Jobs

View all jobs

Python/Data Science Developer

Python/Data Science Developer

Data Engineer - Python & Azure

Software Engineering Professional

Senior Product Manager (AI, ML & Data)

Manager, Data Science

PySpark Development Manager - Financial Risk TechnologyLeading Investment Bank | Canary Wharf, London | £800-£925 per day (Inside IR35) | Hybrid (3 days onsite)Leadership Opportunity in Financial Risk Technology

A prestigious investment bank is seeking an experienced Technical Manager to lead their team of PySpark developers working on mission-critical risk and analytics platforms. This is a hands-on leadership role requiring both technical expertise and people management skills.

Role Overview

You'll be responsible for managing a high-performing team of PySpark developers while providing technical direction on distributed computing solutions for financial risk management. The ideal candidate combines deep technical knowledge with excellent leadership capabilities.

Key Responsibilities

  • Lead and mentor a team of PySpark developers working on risk technology platforms
  • Establish technical standards and architectural direction for data processing systems
  • Oversee development of scalable data pipelines for risk calculations and regulatory reporting
  • Drive continuous improvement in code quality, performance, and development practices
  • Collaborate with stakeholders to align technology solutions with business requirements
  • Manage project delivery, resource allocation, and technical planning

Required Skills & Experience

  • 12+ years in software development with 5+ years in PySpark/big data environments
  • Proven leadership experience managing technical teams in financial services
  • Strong understanding of financial market risk concepts and reporting requirements
  • Deep expertise in distributed computing architectures and performance optimization
  • Experience with agile development practices and CI/CD implementation
  • Excellent communication skills and ability to translate complex technical concepts

This position offers an excellent opportunity to combine technical leadership with people management in a fast-paced financial environment. The successful candidate will shape the future of critical risk technology platforms.

McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.

amdyYWhhbS4xNzI5MS4xMjI3MUBtY2dyZWdvcmJveWFsbC5hcGxpdHJhay5jb20.gif

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

Tips for Staying Inspired: How Machine Learning Pros Fuel Creativity and Innovation

Machine learning (ML) continues to reshape industries—from personalised e-commerce recommendations and autonomous vehicles to advanced healthcare diagnostics and predictive maintenance in manufacturing. Yet behind every revolutionary model lies a challenging and sometimes repetitive process: data cleaning, hyperparameter tuning, infrastructure management, stakeholder communications, and constant performance monitoring. It’s no wonder many ML professionals can experience creative fatigue or get stuck in the daily grind. So, how do machine learning experts keep their spark alive and continually generate fresh ideas? Below, you’ll find ten actionable strategies that successful ML engineers, data scientists, and research scientists use to stay innovative and push boundaries. Whether you’re an experienced practitioner or just breaking into the field, these tips can help you fuel creativity and discover new angles for solving complex problems.

Careers

Top 10 Machine Learning Career Myths Debunked: Key Facts for Aspiring Professionals

Machine learning (ML) has become one of the hottest fields in technology—touching everything from recommendation engines and self-driving cars to language translation and healthcare diagnostics. The immense potential of ML, combined with attractive compensation packages and high-profile success stories, has spurred countless professionals and students to explore this career path. Yet, despite the boom in demand and innovation, machine learning is not exempt from myths and misconceptions. At MachineLearningJobs.co.uk, we’ve had front-row seats to the real-life career journeys and hiring needs in this field. We see, time and again, that outdated assumptions—like needing a PhD from a top university or that ML is purely about deep neural networks—can mislead new entrants and even deter seasoned professionals from making a successful transition. If you’re curious about a career in machine learning or looking to take your existing ML expertise to the next level, this article is for you. Below, we debunk 10 of the most persistent myths about machine learning careers and offer a clear-eyed view of the essential skills, opportunities, and realistic paths forward. By the end, you’ll be better equipped to make informed decisions about your future in this dynamic and rewarding domain.

Careers

Global vs. Local: Comparing the UK Machine Learning Job Market to International Landscapes

How to evaluate opportunities, salaries, and work culture in machine learning across the UK, the US, Europe, and Asia Machine learning (ML) has rapidly transcended the research labs of academia to become a foundational pillar of modern technology. From recommendation engines and autonomous vehicles to fraud detection and personalised healthcare, machine learning techniques are increasingly ubiquitous, transforming how organisations operate. This surge in applications has fuelled an extraordinary global demand for ML professionals—data scientists, ML engineers, research scientists, and more. In this article, we’ll examine how the UK machine learning job market compares to prominent international hubs, including the United States, Europe, and Asia. We’ll explore hiring trends, salary ranges, workplace cultures, and the nuances of remote and overseas roles. Whether you’re a fresh graduate aiming to break into the field, a software engineer with an ML specialisation, or a seasoned professional seeking your next challenge, understanding the global ML landscape is essential for making an informed career move. By the end of this overview, you’ll be equipped with insights into which regions offer the best blend of salaries, work-life balance, and cutting-edge projects—plus practical tips on how to succeed in a domain that’s constantly evolving. Let’s dive in.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.