Picture for Junbing Yan

Junbing Yan

DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models

Add code
Apr 21, 2025
Viaarxiv icon

Training Small Reasoning LLMs with Cognitive Preference Alignment

Add code
Apr 14, 2025
Viaarxiv icon

On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models

Add code
Jun 24, 2024
Figure 1 for On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models
Figure 2 for On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models
Figure 3 for On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models
Figure 4 for On the Role of Long-tail Knowledge in Retrieval Augmented Large Language Models
Viaarxiv icon

TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models

Add code
Mar 17, 2024
Figure 1 for TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
Figure 2 for TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
Figure 3 for TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
Figure 4 for TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models
Viaarxiv icon

Do Large Language Models Understand Logic or Just Mimick Context?

Add code
Feb 19, 2024
Viaarxiv icon

Towards Better Parameter-Efficient Fine-Tuning for Large Language Models: A Position Paper

Add code
Nov 22, 2023
Viaarxiv icon

From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models

Add code
Nov 12, 2023
Figure 1 for From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models
Figure 2 for From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models
Figure 3 for From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models
Figure 4 for From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models
Viaarxiv icon

Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters

Add code
Sep 20, 2023
Viaarxiv icon