HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference

Add code
Nov 03, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: