Picture for Xingbo Du

Xingbo Du

RecurFormer: Not All Transformer Heads Need Self-Attention

Add code
Oct 10, 2024
Viaarxiv icon

Unveiling and Controlling Anomalous Attention Distribution in Transformers

Add code
Jun 26, 2024
Viaarxiv icon