Picture for Ivan Ilin

Ivan Ilin

Thanos: A Block-wise Pruning Algorithm for Efficient Large Language Model Compression

Add code
Apr 06, 2025
Viaarxiv icon

Hessian of Perplexity for Large Language Models by PyTorch autograd (Open Source)

Add code
Apr 06, 2025
Viaarxiv icon

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem

Add code
Nov 26, 2024
Figure 1 for Pushing the Limits of Large Language Model Quantization via the Linearity Theorem
Figure 2 for Pushing the Limits of Large Language Model Quantization via the Linearity Theorem
Figure 3 for Pushing the Limits of Large Language Model Quantization via the Linearity Theorem
Figure 4 for Pushing the Limits of Large Language Model Quantization via the Linearity Theorem
Viaarxiv icon

PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression

Add code
May 23, 2024
Viaarxiv icon

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity

Add code
Feb 07, 2024
Figure 1 for Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
Figure 2 for Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
Figure 3 for Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
Figure 4 for Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
Viaarxiv icon

Kimad: Adaptive Gradient Compression with Bandwidth Awareness

Add code
Dec 13, 2023
Figure 1 for Kimad: Adaptive Gradient Compression with Bandwidth Awareness
Figure 2 for Kimad: Adaptive Gradient Compression with Bandwidth Awareness
Figure 3 for Kimad: Adaptive Gradient Compression with Bandwidth Awareness
Figure 4 for Kimad: Adaptive Gradient Compression with Bandwidth Awareness
Viaarxiv icon