4 papers
Motif-2-12.7B-Reasoning: A Practitioner's Guide to RL Training Recipes
Junghwan Lim, Sungmin Lee, Dongseok Kim +23
We introduce Motif-2-12.7B-Reasoning, a 12.7B parameter language model designed to bridge the gap between open-weight systems and proprietary frontier models in complex reasoning a…
Motif 2 12.7B technical report
Junghwan Lim, Sungmin Lee, Dongseok Kim +22
We introduce Motif-2-12.7B, a new open-weight foundation model that pushes the efficiency frontier of large language models by combining architectural innovation with system-level…
Motif 2.6B Technical Report
Junghwan Lim, Sungmin Lee, Dongseok Kim +22
Recent advancements in Large Language Models (LLMs) have revolutionized artificial intelligence, yet developing an effective foundational LLM that balances high performance with co…
CacheFocus: Dynamic Cache Re-Positioning for Efficient Retrieval-Augmented Generation
Kun-Hui Lee, Eunhwan Park, Donghoon Han +1
Large Language Models (LLMs) excel across a variety of language tasks yet are constrained by limited input lengths and high computational costs. Existing approaches\textemdash such…