Staff Software Engineer, Inference
This role involves building and maintaining large-scale, compute-agnostic inference systems that power Claude for millions of users and support cutting-edge AI research. The engineer will work across the full stack, optimizing intelligent request routing, fleet orchestration, and performance across diverse AI accelerators in multi-cloud environments. Projects include autoscaling infrastructure, integrating new hardware, and developing production pipelines for model deployment.