Picture for Paul-Ioan Clotan

Paul-Ioan Clotan

Change Is the Only Constant: Dynamic LLM Slicing based on Layer Redundancy

Add code
Nov 05, 2024
Viaarxiv icon

Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels

Add code
Jun 26, 2024
Figure 1 for Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels
Figure 2 for Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels
Figure 3 for Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels
Figure 4 for Layer-Wise Quantization: A Pragmatic and Effective Method for Quantizing LLMs Beyond Integer Bit-Levels
Viaarxiv icon