Picture for Xingqi Cui

Xingqi Cui

fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving

Add code
Feb 07, 2025
Figure 1 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Figure 2 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Figure 3 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Figure 4 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Viaarxiv icon