Picture for Kayhan Behdin

Kayhan Behdin

An Optimization Framework for Differentially Private Sparse Fine-Tuning

Add code
Mar 17, 2025
Viaarxiv icon

Efficient AI in Practice: Training and Deployment of Efficient LLMs for Industry Applications

Add code
Feb 20, 2025
Viaarxiv icon

HASSLE-free: A unified Framework for Sparse plus Low-Rank Matrix Decomposition for LLMs

Add code
Feb 02, 2025
Viaarxiv icon

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models

Add code
Jun 12, 2024
Figure 1 for ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
Figure 2 for ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
Figure 3 for ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
Figure 4 for ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models
Viaarxiv icon

End-to-end Feature Selection Approach for Learning Skinny Trees

Add code
Oct 28, 2023
Viaarxiv icon

QuantEase: Optimization-based Quantization for Language Models -- An Efficient and Intuitive Algorithm

Add code
Sep 05, 2023
Viaarxiv icon

Sparse Gaussian Graphical Models with Discrete Optimization: Computational and Statistical Perspectives

Add code
Jul 18, 2023
Figure 1 for Sparse Gaussian Graphical Models with Discrete Optimization: Computational and Statistical Perspectives
Figure 2 for Sparse Gaussian Graphical Models with Discrete Optimization: Computational and Statistical Perspectives
Figure 3 for Sparse Gaussian Graphical Models with Discrete Optimization: Computational and Statistical Perspectives
Figure 4 for Sparse Gaussian Graphical Models with Discrete Optimization: Computational and Statistical Perspectives
Viaarxiv icon

Sharpness-Aware Minimization: An Implicit Regularization Perspective

Add code
Feb 28, 2023
Viaarxiv icon

mSAM: Micro-Batch-Averaged Sharpness-Aware Minimization

Add code
Feb 19, 2023
Viaarxiv icon

Multi-Task Learning for Sparsity Pattern Heterogeneity: A Discrete Optimization Approach

Add code
Dec 16, 2022
Viaarxiv icon