Research Engineer, Pretraining
A Research Engineer on the Pretraining team will bridge cutting-edge AI research and large-scale systems engineering, focusing on advancing large language models through work in model architecture, training optimization, and data processing. The role involves deep collaboration across research and engineering, with hands-on contributions to the full stack—from low-level infrastructure to high-level model design. Key projects include optimizing attention mechanisms, scaling distributed training, and improving model interpretability.