- London
Builds and owns the LLM access layer for agents on the PhysicsX platform, serving self-hosted open models and routing each task to the best-fitting model or combination. Sets technical direction for inference engines like vLLM and SGLang and serving platforms such as KServe, including air-gapped deployments, GPU autoscaling, batching, caching and quantisation. Works with Research and Post-Training specialists to move tuned models into production routes.
vLLM · SGLang · KServe +6