Picture for Chunsheng Zuo

Chunsheng Zuo

TAU: Modeling Temporal Consistency Through Temporal Attentive U-Net for PPG Peak Detection

Add code
Mar 13, 2025
Viaarxiv icon

Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings

Add code
Dec 30, 2024
Figure 1 for Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
Figure 2 for Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
Figure 3 for Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
Figure 4 for Position Information Emerges in Causal Transformers Without Positional Encodings via Similarity of Nearby Embeddings
Viaarxiv icon

Breaking Symmetry When Training Transformers

Add code
Feb 06, 2024
Viaarxiv icon