2 papers
cs.CL2025
Building Domain-Specific Small Language Models via Guided Data Generation
Aman Kumar, Ekant Muljibhai Amin, Xian Yeow Lee +5
Large Language Models (LLMs) have shown remarkable success in supporting a wide range of knowledge-intensive tasks. In specialized domains, there is growing interest in leveraging…
cs.CL2024
Acquiring Bidirectionality via Large and Small Language Models
Takumi Goto, Hiroyoshi Nagao, Yuta Koreeda
Using token representation from bidirectional language models (LMs) such as BERT is still a widely used approach for token-classification tasks. Even though there exist much larger…