The WiLI benchmark dataset for written language identification

Add code
Jan 23, 2018
Martin Thoma
Figure 1 for The WiLI benchmark dataset for written language identification
Figure 2 for The WiLI benchmark dataset for written language identification
Figure 3 for The WiLI benchmark dataset for written language identification
Figure 4 for The WiLI benchmark dataset for written language identification

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon

This paper describes the WiLI-2018 benchmark dataset for monolingual written natural language identification. WiLI-2018 is a publicly available, free of charge dataset of short text extracts from Wikipedia. It contains 1000 paragraphs of 235 languages, totaling in 23500 paragraphs. WiLI is a classification dataset: Given an unknown paragraph written in one dominant language, it has to be decided which language it is.

* {"pages": 12, "figures": 4, "language": "English", "author-ORCiD": ["https://orcid.org/0000-0002-6517-1690"]}  
View paper onarxiv icon

Share this with someone who'll enjoy it:

Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon