Picture for Tomoya Iwakura

Tomoya Iwakura

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization

Add code
Sep 10, 2024
Viaarxiv icon

Tokenization Tractability for Human and Machine Learning Model: An Annotation Study

Add code
Apr 21, 2023
Viaarxiv icon

Downstream Task-Oriented Neural Tokenizer Optimization with Vocabulary Restriction as Post Processing

Add code
Apr 21, 2023
Viaarxiv icon