Code for Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Add code button
avatar
https://llm-stacking.github.io