Senior PySpark Developer

City of London
5 days ago
Create job alert

Senior PySpark Developer
Location: Canary Wharf, London 3 days onsite
Contract to Perm (inside IR35 via umbrella)

Are you a skilled PySpark Developer looking to make an impact in the fast-paced world of investment banking? We are seeking a talented individual to join our dynamic team based in the heart of Canary Wharf, just a short 4-minute walk from the train station. This is an exciting opportunity to enhance your career and contribute to innovative projects in a collaborative environment.

Key Responsibilities:

Develop and maintain scalable data pipelines using PySpark to support our data processing needs.
Collaborate with cross-functional teams to gather requirements and design efficient ETL processes.
Optimise existing data workflows and troubleshoot issues to ensure high performance and reliability.
Implement data processing algorithms and integrate with various data sources, including databases and cloud storage.
Work closely with stakeholders to understand business needs and translate them into technical solutions.
Document processes, best practises, and maintain clear communication with team members.
Required Skills and Qualifications:

Proven experience as a PySpark Developer or in a similar role, within the investment banking sector.
Strong proficiency in PySpark and experience with data manipulation and analysis.
Familiarity with big data technologies and frameworks.
Solid understanding of data warehousing concepts and ETL processes.
Ability to work with SQL and NoSQL databases.
Strong analytical and problem-solving skills.
Excellent communication skills, both verbal and written.
A proactive attitude and the ability to work independently or as part of a team.
Why Join Us?
Hybrid Working Model: Enjoy the flexibility of a hybrid work environment, allowing you to balance your personal and professional life.
Convenient Location: Our office is just a quick 4-minute walk from Canary Wharf train station, making your daily commute easier.
Competitive day rate/salary: We offer an attractive salary package commensurate with your experience and skills.
Career Development: Take advantage of ongoing training and development opportunities to advance your career in the investment banking sector.
Collaborative Environment: Be part of a supportive team that values creativity, innovation, and collaboration.
Social Events: Participate in regular team-building activities and social events to foster a positive work culture.

If you are ready to take the next step in your career and make a significant contribution to our team, we want to hear from you! Apply now with your CV and a brief cover letter detailing your relevant experience and why you are the right fit for this role. please note, due to high volumes, only shortlisted candidates will be contacted.

Adecco is a disability-confident employer. It is important to us that we run an inclusive and accessible recruitment process to support candidates of all backgrounds and all abilities to apply. Adecco is committed to building a supportive environment for you to explore the next steps in your career. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you

Related Jobs

View all jobs

Software Engineering Professional

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Product Manager (AI, ML & Data)

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Books to Advance Your Machine Learning Career in the UK

Machine learning (ML) remains one of the fastest-growing fields within technology, reshaping industries across the UK from finance and healthcare to e-commerce, telecommunications, and beyond. With increasing demand for ML specialists, job seekers who continually update their knowledge and skills hold a significant advantage. In this article, we've curated ten essential books every machine learning professional or aspiring ML engineer in the UK should read. Covering foundational theory, practical implementations, advanced techniques, and industry trends, these resources will equip you to excel in your machine learning career.

Navigating Machine Learning Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Machine learning (ML) has swiftly become one of the most in-demand skill areas across industries, with companies leveraging predictive models and data-driven insights to solve challenges in healthcare, finance, retail, manufacturing, and beyond. Whether you’re an early-career data scientist aiming to break into ML, a seasoned engineer branching into deep learning, or a product manager exploring AI-driven solutions, machine learning career fairs offer a powerful route to connect with prospective employers face-to-face. Attending these events can help you: Network with hiring managers and technical leads who make direct recruitment decisions. Gain insider insights on the latest ML trends and tools. Learn about emerging job roles and new industry verticals adopting machine learning. Showcase your interpersonal and communication skills, both of which are increasingly important in collaborative AI/ML environments. However, with many applicants vying for attention in a bustling hall, standing out isn’t always easy. In this detailed guide, we’ll walk you through how to prepare meticulously, pitch yourself confidently, ask relevant questions, and follow up effectively to land the machine learning opportunity that aligns with your ambitions.

Common Pitfalls Machine Learning Job Seekers Face and How to Avoid Them

Machine learning has emerged as one of the most sought-after fields in technology, with companies across industries—from retail and healthcare to finance and manufacturing—embracing data-driven solutions at an unprecedented pace. In the UK, the demand for skilled ML professionals continues to soar, and opportunities in this domain are abundant. Yet, amid this growing market, competition for machine learning jobs can be fierce. Prospective employers set a high bar: they seek candidates with not just theoretical understanding, but also strong practical skills, business sense, and an aptitude for effective communication. Whether you’re a recent graduate, a data scientist transitioning into machine learning, or a seasoned developer pivoting your career, it’s essential to avoid common mistakes that may hinder your prospects. This blog post explores the pitfalls frequently encountered by machine learning job seekers, and offers actionable guidance on how to steer clear of them. If you’re looking for roles in this thriving sector, don’t forget to check out Machine Learning Jobs for the latest vacancies across the UK. In this article, we’ll break down these pitfalls to help you refine your approach in applications, interviews, and career development. By taking on board these insights, you can significantly enhance your employability, stand out from the competition, and secure a rewarding position in the world of machine learning.