Picture for Rakuten Group

Rakuten Group

RakutenAI-7B: Extending Large Language Models for Japanese

Add code
Mar 21, 2024
Rakuten Group, Aaron Levine, Connie Huang, Chenguang Wang, Eduardo Batista, Ewa Szymanska, Hongyi Ding, Hou Wei Chou, Jean-François Pessiot, Johanes Effendi(+20 more)
Figure 1 for RakutenAI-7B: Extending Large Language Models for Japanese
Figure 2 for RakutenAI-7B: Extending Large Language Models for Japanese
Figure 3 for RakutenAI-7B: Extending Large Language Models for Japanese
Figure 4 for RakutenAI-7B: Extending Large Language Models for Japanese

We introduce RakutenAI-7B, a suite of Japanese-oriented large language models that achieve the best performance on the Japanese LM Harness benchmarks among the open 7B models. Along with the foundation model, we release instruction- and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat respectively, under the Apache 2.0 license.

Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon