Picture for Christos Perivolaropoulos

Christos Perivolaropoulos

Why do LLMs attend to the first token?

Add code
Apr 03, 2025
Viaarxiv icon

Round and Round We Go! What makes Rotary Positional Encodings useful?

Add code
Oct 08, 2024
Viaarxiv icon

softmax is not enough (for sharp out-of-distribution)

Add code
Oct 01, 2024
Viaarxiv icon