AI Engineer: Evals
- London
Build the evaluation discipline for production AI agents, creating reusable frameworks, datasets and evaluators that combine deterministic checks, expert judgement, model-based grading and human review. Own cross-product scorecards, public benchmarks and production telemetry, coaching product and delivery teams to embed rigorous evaluation into their workflows.
Pydantic Evals · Pydantic Logfire · OpenTelemetry