SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration

Add code
Oct 09, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: