LocMoE+: Enhanced Router with Token Feature Awareness for Efficient LLM Pre-Training

Add code
May 24, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: