Picture for Longteng Zhang

Longteng Zhang

Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

Add code
Nov 07, 2023
Viaarxiv icon

FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs

Add code
Sep 03, 2023
Viaarxiv icon

LoRA-FA: Memory-efficient Low-rank Adaptation for Large Language Models Fine-tuning

Add code
Aug 07, 2023
Viaarxiv icon

Evaluation and Optimization of Gradient Compression for Distributed Deep Learning

Add code
Jun 15, 2023
Viaarxiv icon