2 papers
cs.CL2025
Beyond Text Compression: Evaluating Tokenizers Across Scales
Jonas F. Lotz, António V. Lopes, Stephan Peitz +2
The choice of tokenizer can profoundly impact language model performance, yet accessible and reliable evaluations of tokenizer quality remain an open challenge. Inspired by scaling…
cs.LG2023
Neural Language Model Pruning for Automatic Speech Recognition
Leonardo Emili, Thiago Fraga-Silva, Ernest Pusateri +2
We study model pruning methods applied to Transformer-based neural network language models for automatic speech recognition. We explore three aspects of the pruning frame work, nam…