Dynamic Depth Decoding: Faster Speculative Decoding for LLMs

Add code
Aug 30, 2024
Figure 1 for Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
Figure 2 for Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
Figure 3 for Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
Figure 4 for Dynamic Depth Decoding: Faster Speculative Decoding for LLMs

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: