Picture for Tairan Xu

Tairan Xu

MoE-Gen: High-Throughput MoE Inference on a Single GPU with Module-Based Batching

Add code
Mar 12, 2025
Viaarxiv icon