ElevenLabs
Research Engineer - Web Crawlers
- United Kingdom
- Remote
- Mid-level
- Permanent
Owns large-scale distributed web crawling systems that discover, fetch and extract data from billions of pages to feed frontier AI models. Work spans content extraction from messy HTML, deduplication at web scale, recrawl and freshness strategies, politeness and rate limiting, plus tooling for researchers to request and explore crawled data.
Kubernetes