Picture for David Yao

David Yao

Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions

Add code
May 23, 2024
Figure 1 for Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions
Figure 2 for Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions
Figure 3 for Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions
Figure 4 for Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions
Viaarxiv icon