2 papers
cs.CL2025
When Every Token Counts: Optimal Segmentation for Low-Resource Language Models
Bharath Raj, Garvit Suri, Vikrant Dewangan +1
Traditional greedy tokenization methods have been a critical step in Natural Language Processing (NLP), influencing how text is converted into tokens and directly impacting model p…
cs.CL2024
HiLight: A Hierarchy-aware Light Global Model with Hierarchical Local ConTrastive Learning
Zhijian Chen, Zhonghua Li, Jianxin Yang +1
Hierarchical text classification (HTC) is a special sub-task of multi-label classification (MLC) whose taxonomy is constructed as a tree and each sample is assigned with at least o…