Cohere
Senior Member of Technical Staff, Web Data
- London
- Remote
- Senior
- Permanent
Owns key components of a large-scale web data pipeline for pre-training language models, covering extraction, parsing, deduplication and filtering of noisy internet corpora. Analyses data composition and quality across domains, languages and time periods, and studies its impact on downstream model performance alongside research and evaluation teams.
Apache Spark · Apache Beam · Pandas