Picture for XiaoDong Han

XiaoDong Han

PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference

Add code
May 21, 2024
Figure 1 for PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
Figure 2 for PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
Figure 3 for PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
Figure 4 for PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
Viaarxiv icon

The Devil in Linear Transformer

Add code
Oct 19, 2022
Figure 1 for The Devil in Linear Transformer
Figure 2 for The Devil in Linear Transformer
Figure 3 for The Devil in Linear Transformer
Figure 4 for The Devil in Linear Transformer
Viaarxiv icon