Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training

Add code
Oct 31, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: