Picture for Sike Wang

Sike Wang

SubZero: Random Subspace Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning

Add code
Oct 11, 2024
Figure 1 for SubZero: Random Subspace Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning
Figure 2 for SubZero: Random Subspace Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning
Figure 3 for SubZero: Random Subspace Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning
Figure 4 for SubZero: Random Subspace Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning
Viaarxiv icon

4-bit Shampoo for Memory-Efficient Network Training

Add code
May 28, 2024
Viaarxiv icon