Picture for Vikram Appia

Vikram Appia

X-EcoMLA: Upcycling Pre-Trained Attention into MLA for Efficient and Extreme KV Compression

Add code
Mar 14, 2025
Viaarxiv icon