Round Attention: A Novel Round-Level Attention Mechanism to Accelerate LLM Inference

Add code
Feb 21, 2025

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: