Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining

Add code
Jul 01, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: