Head-wise Shareable Attention for Large Language Models

Add code
Feb 19, 2024
Figure 1 for Head-wise Shareable Attention for Large Language Models
Figure 2 for Head-wise Shareable Attention for Large Language Models
Figure 3 for Head-wise Shareable Attention for Large Language Models
Figure 4 for Head-wise Shareable Attention for Large Language Models

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: