4 citations · 6 across the 4 of their papers we have counts for
1 paper · 1 filter
Shuhao Gu, Mengdi Zhao, Bowen Zhang +3
Tokenizer is an essential component for large language models (LLMs), and a tokenizer with a high compression rate can improve the model's representation and processing efficiency.…