fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving

Add code
Feb 07, 2025
Figure 1 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Figure 2 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Figure 3 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving
Figure 4 for fMoE: Fine-Grained Expert Offloading for Large Mixture-of-Experts Serving

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: