Picture for Dhabaleswar K. Panda

Dhabaleswar K. Panda

Accelerating Large Language Model Training with Hybrid GPU-based Compression

Add code
Sep 04, 2024
Viaarxiv icon

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer

Add code
Aug 30, 2024
Viaarxiv icon

Efficient MPI-based Communication for GPU-Accelerated Dask Applications

Add code
Jan 21, 2021
Figure 1 for Efficient MPI-based Communication for GPU-Accelerated Dask Applications
Figure 2 for Efficient MPI-based Communication for GPU-Accelerated Dask Applications
Figure 3 for Efficient MPI-based Communication for GPU-Accelerated Dask Applications
Figure 4 for Efficient MPI-based Communication for GPU-Accelerated Dask Applications
Viaarxiv icon