MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression

Add code
Oct 28, 2024

Share this with someone who'll enjoy it:

View paper onarxiv icon

Share this with someone who'll enjoy it: