Picture for Varun Gumma

Varun Gumma

Contamination Report for Multilingual Benchmarks

Add code
Oct 21, 2024
Viaarxiv icon

HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings

Add code
Oct 17, 2024
Figure 1 for HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
Figure 2 for HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
Figure 3 for HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
Figure 4 for HEALTH-PARIKSHA: Assessing RAG Models for Health Chatbots in Real-World Multilingual Settings
Viaarxiv icon

On the Interchangeability of Positional Embeddings in Multilingual Neural Machine Translation Models

Add code
Aug 21, 2024
Viaarxiv icon

PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data

Add code
Jun 21, 2024
Figure 1 for PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
Figure 2 for PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
Figure 3 for PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
Figure 4 for PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
Viaarxiv icon

Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios

Add code
Jun 01, 2024
Figure 1 for Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
Figure 2 for Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
Figure 3 for Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
Figure 4 for Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
Viaarxiv icon

Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology

Add code
May 10, 2024
Viaarxiv icon

METAL: Towards Multilingual Meta-Evaluation

Add code
Apr 02, 2024
Viaarxiv icon

MAFIA: Multi-Adapter Fused Inclusive LanguAge Models

Add code
Feb 12, 2024
Figure 1 for MAFIA: Multi-Adapter Fused Inclusive LanguAge Models
Figure 2 for MAFIA: Multi-Adapter Fused Inclusive LanguAge Models
Figure 3 for MAFIA: Multi-Adapter Fused Inclusive LanguAge Models
Figure 4 for MAFIA: Multi-Adapter Fused Inclusive LanguAge Models
Viaarxiv icon

MunTTS: A Text-to-Speech System for Mundari

Add code
Jan 28, 2024
Viaarxiv icon

An Empirical Analysis of In-context Learning Abilities of LLMs for MT

Add code
Jan 22, 2024
Figure 1 for An Empirical Analysis of In-context Learning Abilities of LLMs for MT
Figure 2 for An Empirical Analysis of In-context Learning Abilities of LLMs for MT
Figure 3 for An Empirical Analysis of In-context Learning Abilities of LLMs for MT
Figure 4 for An Empirical Analysis of In-context Learning Abilities of LLMs for MT
Viaarxiv icon