Picture for Shuzhen Sun

Shuzhen Sun

The Scaling Law for LoRA Base on Mutual Information Upper Bound

Add code
Jan 06, 2025
Figure 1 for The Scaling Law for LoRA Base on Mutual Information Upper Bound
Figure 2 for The Scaling Law for LoRA Base on Mutual Information Upper Bound
Figure 3 for The Scaling Law for LoRA Base on Mutual Information Upper Bound
Figure 4 for The Scaling Law for LoRA Base on Mutual Information Upper Bound
Viaarxiv icon

SEE: Sememe Entanglement Encoding for Transformer-bases Models Compression

Add code
Dec 15, 2024
Viaarxiv icon