Picture for Sophia Ho

Sophia Ho

CREST: Effectively Compacting a Datastore For Retrieval-Based Speculative Decoding

Add code
Aug 08, 2024
Viaarxiv icon