Picture for Christos Perivolaropoulos

Christos Perivolaropoulos

Round and Round We Go! What makes Rotary Positional Encodings useful?

Add code
Oct 08, 2024
Viaarxiv icon

softmax is not enough (for sharp out-of-distribution)

Add code
Oct 01, 2024
Viaarxiv icon