4 papers · 1 filter
ReFusion: A Diffusion Large Language Model with Parallel Autoregressive Decoding
Jia-Nan Li, Jian Guan, Wei Wu +1
Autoregressive models (ARMs) are hindered by slow sequential inference. While masked diffusion models (MDMs) offer a parallel alternative, they suffer from critical drawbacks: high…
Data Efficacy for Language Model Training
Yalun Dai, Yangyu Huang, Xin Zhang +6
Data is fundamental to the training of language models (LM). Recent research has been dedicated to data efficiency, which aims to maximize performance by selecting a minimal or opt…
Efficient Medical VIE via Reinforcement Learning
Lijun Liu, Ruiyang Li, Zhaocheng Liu +5
Visual Information Extraction (VIE) converts unstructured document images into structured formats like JSON, critical for medical applications such as report analysis and online co…
Enhancing Low-Resource Minority Language Translation with LLMs and Retrieval-Augmented Generation for Cultural Nuances
Chen-Chi Chang, Chong-Fu Li, Chu-Hsuan Lee +1
This study investigates the challenges of translating low-resource languages by integrating Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG). Various model co…