Are Transformers with One Layer Self-Attention Using Low-Rank Weight Matrices Universal Approximators?

Add code
Jul 26, 2023

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: