Picture for Jie Ye

Jie Ye

Deep Optimizer States: Towards Scalable Training of Transformer Models Using Interleaved Offloading

Add code
Oct 26, 2024
Viaarxiv icon