Picture for Renjie Song

Renjie Song

Asymmetric Decision-Making in Online Knowledge Distillation:Unifying Consensus and Divergence

Add code
Mar 09, 2025
Viaarxiv icon

Cumulative Spatial Knowledge Distillation for Vision Transformers

Add code
Jul 17, 2023
Viaarxiv icon

DOT: A Distillation-Oriented Trainer

Add code
Jul 17, 2023
Figure 1 for DOT: A Distillation-Oriented Trainer
Figure 2 for DOT: A Distillation-Oriented Trainer
Figure 3 for DOT: A Distillation-Oriented Trainer
Figure 4 for DOT: A Distillation-Oriented Trainer
Viaarxiv icon

Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?

Add code
May 22, 2023
Figure 1 for Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?
Figure 2 for Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?
Figure 3 for Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?
Figure 4 for Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?
Viaarxiv icon

A Survey of Historical Learning: Learning Models with Learning History

Add code
Mar 23, 2023
Figure 1 for A Survey of Historical Learning: Learning Models with Learning History
Figure 2 for A Survey of Historical Learning: Learning Models with Learning History
Figure 3 for A Survey of Historical Learning: Learning Models with Learning History
Figure 4 for A Survey of Historical Learning: Learning Models with Learning History
Viaarxiv icon

Boosting Semi-Supervised Learning by Exploiting All Unlabeled Data

Add code
Mar 20, 2023
Viaarxiv icon

Curriculum Temperature for Knowledge Distillation

Add code
Dec 04, 2022
Figure 1 for Curriculum Temperature for Knowledge Distillation
Figure 2 for Curriculum Temperature for Knowledge Distillation
Figure 3 for Curriculum Temperature for Knowledge Distillation
Figure 4 for Curriculum Temperature for Knowledge Distillation
Viaarxiv icon

Decoupled Knowledge Distillation

Add code
Mar 16, 2022
Figure 1 for Decoupled Knowledge Distillation
Figure 2 for Decoupled Knowledge Distillation
Figure 3 for Decoupled Knowledge Distillation
Figure 4 for Decoupled Knowledge Distillation
Viaarxiv icon

RecursiveMix: Mixed Learning with History

Add code
Mar 14, 2022
Figure 1 for RecursiveMix: Mixed Learning with History
Figure 2 for RecursiveMix: Mixed Learning with History
Figure 3 for RecursiveMix: Mixed Learning with History
Figure 4 for RecursiveMix: Mixed Learning with History
Viaarxiv icon

Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective

Add code
Mar 08, 2022
Figure 1 for Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective
Figure 2 for Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective
Figure 3 for Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective
Figure 4 for Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective
Viaarxiv icon