Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Scaling Law: Optimizing Multi-Epoch, Multi-Lingual, and Multi-Stage Training for Low-Resource Language Models
Kosuke Akimoto, Taiki Miyagawa, Masafumi Oyamada
In this paper, we study a fundamental design problem in pretraining Large Language Models (LLMs) for low-resource language regimes. Existing works adopt multi-epoch, multi-lingual,…
cs.CL2024
LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization
Masafumi Enomoto, Kunihiro Takeoka, Kosuke Akimoto +2
Open-Domain Multi-Document Summarization (ODMDS) is the task of generating summaries from large document collections in response to user queries. This task is crucial for efficient…