Picture for Qiheng Lv

Qiheng Lv

Round Attention: A Novel Round-Level Attention Mechanism to Accelerate LLM Inference

Add code
Feb 21, 2025
Viaarxiv icon