Picture for Heungsub Lee

Heungsub Lee

What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers

Add code
Sep 10, 2021
Figure 1 for What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers
Figure 2 for What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers
Figure 3 for What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers
Figure 4 for What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers
Viaarxiv icon

torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models

Add code
Apr 21, 2020
Figure 1 for torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models
Figure 2 for torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models
Figure 3 for torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models
Figure 4 for torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models
Viaarxiv icon