Picture for Aleksandr Mikhalev

Aleksandr Mikhalev

Quantization of Large Language Models with an Overdetermined Basis

Add code
Apr 15, 2024
Viaarxiv icon

LoTR: Low Tensor Rank Weight Adaptation

Add code
Feb 05, 2024
Viaarxiv icon

Run LoRA Run: Faster and Lighter LoRA Implementations

Add code
Dec 06, 2023
Figure 1 for Run LoRA Run: Faster and Lighter LoRA Implementations
Figure 2 for Run LoRA Run: Faster and Lighter LoRA Implementations
Figure 3 for Run LoRA Run: Faster and Lighter LoRA Implementations
Figure 4 for Run LoRA Run: Faster and Lighter LoRA Implementations
Viaarxiv icon

Memory-Efficient Backpropagation through Large Linear Layers

Add code
Feb 02, 2022
Figure 1 for Memory-Efficient Backpropagation through Large Linear Layers
Figure 2 for Memory-Efficient Backpropagation through Large Linear Layers
Figure 3 for Memory-Efficient Backpropagation through Large Linear Layers
Figure 4 for Memory-Efficient Backpropagation through Large Linear Layers
Viaarxiv icon