Finch: Prompt-guided Key-Value Cache Compression

Add code
Jul 31, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: