Picture for Jaesin Ahn

Jaesin Ahn

Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints

Add code
Nov 19, 2021
Figure 1 for Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints
Figure 2 for Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints
Figure 3 for Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints
Figure 4 for Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints
Viaarxiv icon