Picture for Ong Yew Soon

Ong Yew Soon

ExpertFlow: Optimized Expert Activation and Token Allocation for Efficient Mixture-of-Experts Inference

Add code
Oct 23, 2024
Viaarxiv icon