Picture for Xutao Liao

Xutao Liao

GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection

Add code
Dec 15, 2024
Figure 1 for GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
Figure 2 for GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
Figure 3 for GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
Figure 4 for GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
Viaarxiv icon