Picture for Jianqiao Zheng

Jianqiao Zheng

Rethinking Softmax: Self-Attention with Polynomial Activations

Add code
Oct 24, 2024
Viaarxiv icon

Structured Initialization for Attention in Vision Transformers

Add code
Apr 01, 2024
Viaarxiv icon

Convolutional Initialization for Data-Efficient Vision Transformers

Add code
Jan 23, 2024
Viaarxiv icon

Robust Point Cloud Processing through Positional Embedding

Add code
Sep 01, 2023
Viaarxiv icon

Fast Neural Scene Flow

Add code
Apr 20, 2023
Viaarxiv icon

Trading Positional Complexity vs. Deepness in Coordinate Networks

Add code
May 18, 2022
Figure 1 for Trading Positional Complexity vs. Deepness in Coordinate Networks
Figure 2 for Trading Positional Complexity vs. Deepness in Coordinate Networks
Figure 3 for Trading Positional Complexity vs. Deepness in Coordinate Networks
Figure 4 for Trading Positional Complexity vs. Deepness in Coordinate Networks
Viaarxiv icon

Rethinking Positional Encoding

Add code
Jul 13, 2021
Figure 1 for Rethinking Positional Encoding
Figure 2 for Rethinking Positional Encoding
Figure 3 for Rethinking Positional Encoding
Figure 4 for Rethinking Positional Encoding
Viaarxiv icon