Senior Data Engineer

Direct message the job poster from Selby Jennings

Consultant | Data & Analytics | Selby Jennings

Our client is redefining electronic trading by developing high-performance, AI-powered solutions that enable smarter, faster decision-making in dynamic markets. Our client is looking for a Senior Data Engineer to be a part of a forward-thinking team in London, working at the intersection of AI and trading technology. You'll collaborate with leading researchers, data scientists, and engineers to build scalable data infrastructure that supports advanced analytics and machine learning. This is a greenfield opportunity with full ownership from design to deployment, allowing you to shape systems that directly impact trading and AI capabilities.

In this role, you'll architect and maintain robust data pipelines for ingesting, transforming, and storing large volumes of structured and unstructured data, including time-series datasets. You'll automate ETL processes, implement validation frameworks, and ensure high data quality and system reliability. You'll also support AI model development by optimising data retrieval, integrating scalable APIs, and working with vector databases such as FAISS and Pinecone. Familiarity with MLOps, LLM workflows, and RAG frameworks is essential, along with experience deploying AI/ML models into production environments. Your work will be critical to enabling rapid experimentation, research validation, and the seamless transition of prototypes into production.

Key Responsibilities:

• Develop and maintain scalable pipelines for ingesting, transforming, and storing large volumes of data.
• Design systems for handling text-heavy and time-series data, ensuring performance and reliability.
• Collaborate with data scientists to optimise data retrieval and training workflows for AI models.
• Automate ETL processes and improve data quality through validation and monitoring tools.
• Support experimentation and deployment by building flexible, production-ready data systems.
• Ensure strong documentation, coding standards, and data governance practices.
• Support AI research and production systems, collaborating with Principal data scientist to operationalise RAG systems
• Architect and implement data ingestion, transformation, storage, and retrieval systems, ensuring they are resilient, high-performing, and fit for future growth.

Requirements:

• 5+ years in data engineering with strong SQL and cloud data platform experience.
• Skilled in handling unstructured data and NLP datasets.
• Familiar with MLOps, RAG frameworks, and deploying AI/ML models into production.
• Experience implementing APIs, vector databases (e.g., FAISS, Pinecone), and LLM pipelines.
• Knowledge of data security, versioning tools (e.g., DVC, MLflow), and time-series databases.

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeFull-time

Job function

• Job functionFinance

Referrals increase your chances of interviewing at Selby Jennings by 2x

Get notified about new Senior Data Engineer jobs inCity Of London, England, United Kingdom.

Surrey, England, United Kingdom 1 month ago

London, England, United Kingdom 1 week ago

Chigwell, England, United Kingdom 3 weeks ago

City Of London, England, United Kingdom 2 days ago

London, England, United Kingdom 2 weeks ago

Greater London, England, United Kingdom 3 days ago

London, England, United Kingdom 1 month ago

Senior Data Engineer | Energy Trading | Python, Snowflake, Dagster, & AWS | Up to £140,000 + Bonus | Hybrid – LondonSenior Data Engineer_London_Hybrid(6+ Years)Team Lead - Senior Analytics Engineer - Utilities

London, England, United Kingdom 2 weeks ago

Senior Software Engineer - Card Integrations - Visa / Mastercard

London, England, United Kingdom 2 weeks ago

Senior Data Analyst | Greenfield Trading House | Up to £100k + Bonus | London Hybrid 3x/weekSenior Government Finance Function (GFF) Data Architect / Engineer

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 weeks ago

Senior Software Engineer, Robotics & Microscope Control

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 month ago

Senior Data Analyst (Operations) - Enterprise Product

London, England, United Kingdom 4 days ago

Data Architect - Data Modelling - Dimensional - Relational - Data Vault

London, England, United Kingdom 1 week ago

London, England, United Kingdom 2 days ago

Isleworth, England, United Kingdom 2 days ago

Senior AI/ML Engineer (Data Science & Software Focus)

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 2 months ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 6 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr