Picture for Venmugil Elango

Venmugil Elango

ATTENTION2D: Communication Efficient Distributed Self-Attention Mechanism

Add code
Mar 20, 2025
Viaarxiv icon

PaSE: Parallelization Strategies for Efficient DNN Training

Add code
Jul 04, 2024
Figure 1 for PaSE: Parallelization Strategies for Efficient DNN Training
Figure 2 for PaSE: Parallelization Strategies for Efficient DNN Training
Figure 3 for PaSE: Parallelization Strategies for Efficient DNN Training
Figure 4 for PaSE: Parallelization Strategies for Efficient DNN Training
Viaarxiv icon

Microscaling Data Formats for Deep Learning

Add code
Oct 19, 2023
Figure 1 for Microscaling Data Formats for Deep Learning
Figure 2 for Microscaling Data Formats for Deep Learning
Figure 3 for Microscaling Data Formats for Deep Learning
Figure 4 for Microscaling Data Formats for Deep Learning
Viaarxiv icon

Shared Microexponents: A Little Shifting Goes a Long Way

Add code
Feb 16, 2023
Figure 1 for Shared Microexponents: A Little Shifting Goes a Long Way
Figure 2 for Shared Microexponents: A Little Shifting Goes a Long Way
Figure 3 for Shared Microexponents: A Little Shifting Goes a Long Way
Figure 4 for Shared Microexponents: A Little Shifting Goes a Long Way
Viaarxiv icon