Picture for Zhicheng Hu

Zhicheng Hu

Round Attention: A Novel Round-Level Attention Mechanism to Accelerate LLM Inference

Add code
Feb 21, 2025
Viaarxiv icon