Jobs

Lead Data Engineer


Job details
  • First Derivative
  • London
  • 2 days ago

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?

Lead Data Engineer - London

First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.

Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.

We have opportunities for Mid-Senior Software Engineers who will work shoulder to shoulder with Tier 1 investment banks, including Morgan Stanley, UBS, Citigroup, JP Morgan and Credit Suisse to name a few.

What will you do?

The project entails the development of a robust Risk Data Platform built on Snowflake, leveraging AWS as the cloud infrastructure.

The platform will support multiple risk applications, incorporating tailored risk matrices for individual desks to ensure comprehensive and granular risk management. The integration will include a high-performance risk engine powered by Murex, facilitating advanced risk computations and analysis.

The scope covers the design, implementation, and testing of the platform to meet the specified requirements, ensuring scalability, security, and efficient data handling across all risk operations.

What experience will you need?

Essential Requirements:

Experience in risk analytics, including market risk or credit risk.Familiarity with risk technology and calculations, including VaR, Stress Testing, Sensitivities, and P&L Vectors.Strong software development skills in Python or another common programming language (e.g., Java or Scala), with a focus on best practices: low-level design documentation, clean and well-documented code, and thorough testing.Expertise in Apache Airflow, with demonstrated experience designing, implementing, and managing workflows, DAGs, and tasks. A deep understanding of Airflow's architecture, best practices, and troubleshooting capabilities is mandatory.Proficiency in deploying and managing Cloud Database Services, with a preference for Snowflake.Advanced skills in SQL and Python for data manipulation and analysis.Experience implementing cloud-based solutions using modern cloud technologies (preferably AWS).Familiarity with modern SDLC tooling, including Git, Bamboo, Jira, or similar.Proven ability to implement and enforce data quality standards and practices.

Preferred Qualifications (Nice to Have):Good base of derivatives knowledge, pricing, risk management of structured products, options and more exotic derivatives.Knowledge of additional data processing libraries and tools to enhance data engineering workflows.Expertise in real-time data processing frameworks such as Apache Flink or Kafka Streams.Experience building event-driven and/or streaming data services.

Soft Skills:Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex data-related issues effectively.Excellent communication skills, with the ability to collaborate and share knowledge within a team environment.Proactive, self-starter attitude with an entrepreneurial approach.Ability to escalate and follow up on issues promptly and efficiently.

What's in it for you?

You will embark upon a career with life-long learning at its core, facilitating rapid professional and personal development and the opportunity to design your own career path.

Benefits:

Hybrid and Flexible WorkingExtensive Private Healthcare PackagePrivate PensionEmployee Assistance ProgrammeEnhanced Maternity/ Paternity policiesGroup Life Protection BenefitEmployee Referral Bonus SchemeAccess to a range of skills and certifications such as GCP, AWS, Azure and more!

Additional Perks:

FD Internal Network and Sports & Social Calendar, who host monthly and quarterly socials at each office.Aspiring LeadershipProgramme

– a programme which provides a structured and practical pathway to fast-track talented individuals into leadership roles.STEP-up Awards

- employee led awards designed to acknowledge excellence in four areas that are quintessential to us.TechSmiths Guild

– helping employees get to grips with everything cloud computing and data storage (which are integral to the future of business and risk management).STRIVE Initiative and IMPACT Programme

– development programmes put in place to support women in tech and financial services.Investment Club

- employees learn the basics of investment and trading via workshops and competitions, mirroring real-life scenarios.Food Club

– the opportunity to try out new cuisines together as a teamSports Club

– a bit of healthy competition! Getting involved in 5k fun runs, JPM challenge and SCB challenge.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer - (MongoDB and Kafka)

Lead Data Engineer (MongoDB, Kafka, Java)Salary: Competitive plus generous benefits package Location: Hybrid working with occasional travel to key sites across the UK (London, Bristol, Gloucester, Edinburgh)About the Role A leading financial services organization is undergoing a major digital transformation, placing technology at the heart of its growth strategy. They...

Develop

Lead Data Engineer

Lead Data Engineer | FinTech | Scale-up | £80-100k | London/hybridAt G.Digital, we love partnering with business' who are revolutionising their industry and it's a pleasure to be partnered with a scaling, FinTech provider in LondonWe've already supported this business to grow across Test, Engineering and C-Suite and now they...

G.Digital London

Lead Data Engineer

SR2 is partnered with a UK-based consultancy making animpact across Finance, Retail & Government, who are urgentlylooking to hire several Lead Data Engineers. We are looking forData Engineers to onboard across Q1 next year - 7 in January, 16 inFebruary & 15 in March. Location: All roles are London-basedand have...

SR2 | Socially Responsible Recruitment | Certified BCorporation London

Lead Data Engineer

Internal use only – Grade EAbout usWe are The Very Group and we’re here to help families get more out of life. We know that our customers work hard for their families and have a lot to balance in their busy lives. That’s why we combine amazing brands and products...

The Very Group Liverpool

Segmentation Lead Data Engineer

We are looking for an SC Cleared Segmentation Lead Data Engineer for one of our public sector clients. * Rate: up to £800 per day * Duration: until the 31st March 2025 * Inside IR35 * Location: London * Must have Active SC ClearanceAs a Segmentation Lead Data Engineer you...

AdRoc London

DataCareers | Lead Data Engineer

Job Title:Lead Data EngineerLocation:Yorkshire (Hybrid Working - mostly remote)Salary:£55,000-60,000Sector:Public SectorAbout the Role:We are delighted to be recruiting on behalf of a forward-thinking public sector organisation that is seeking an experiencedData Team Manager / Lead Data Engineerto lead and deliver critical modern data services. This is a unique opportunity to manage...

DataCareers Glasgow