Picture for Maryam Akhavan Aghdam

Maryam Akhavan Aghdam

DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models

Add code
Sep 10, 2024
Figure 1 for DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
Figure 2 for DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
Figure 3 for DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
Figure 4 for DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
Viaarxiv icon