Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

Add code
Mar 12, 2025

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: