MiniKV: Pushing the Limits of LLM Inference via 2-Bit Layer-Discriminative KV Cache

Add code
Nov 28, 2024
Figure 1 for MiniKV: Pushing the Limits of LLM Inference via 2-Bit Layer-Discriminative KV Cache
Figure 2 for MiniKV: Pushing the Limits of LLM Inference via 2-Bit Layer-Discriminative KV Cache
Figure 3 for MiniKV: Pushing the Limits of LLM Inference via 2-Bit Layer-Discriminative KV Cache
Figure 4 for MiniKV: Pushing the Limits of LLM Inference via 2-Bit Layer-Discriminative KV Cache

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: