ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing

Add code
Dec 19, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: