Picture for Sakshi Choudhary

Sakshi Choudhary

Eigen Attention: Attention in Low-Rank Space for KV Cache Compression

Add code
Aug 10, 2024
Figure 1 for Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
Figure 2 for Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
Figure 3 for Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
Figure 4 for Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
Viaarxiv icon

SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data

Add code
May 22, 2024
Viaarxiv icon

Averaging Rate Scheduler for Decentralized Learning on Heterogeneous Data

Add code
Mar 05, 2024
Viaarxiv icon

CoDeC: Communication-Efficient Decentralized Continual Learning

Add code
Mar 27, 2023
Viaarxiv icon