Picture for Shubhangi Upasani

Shubhangi Upasani

LLMs Know What to Drop: Self-Attention Guided KV Cache Eviction for Efficient Long-Context Inference

Add code
Mar 11, 2025
Viaarxiv icon