Picture for Anurag Khandelwal

Anurag Khandelwal

Prompt Cache: Modular Attention Reuse for Low-Latency Inference

Add code
Nov 07, 2023
Viaarxiv icon