6 papers
BamiBERT: A New BERT-based Language Model for Vietnamese
Dat Quoc Nguyen, Thinh Pham, Chi Tran +1
In this paper, we introduce BamiBERT, a new BERT-based pre-trained language model for Vietnamese that addresses key limitations of PhoBERT -- the current de facto Vietnamese text e…
Cross-Space Distillation: Teaching One-Step Students with Modern Diffusion Teachers
Anh Nguyen, Ngan Nguyen, Duc Vu +11
Modern one-step diffusion models achieve impressive quality through distribution-based timestep distillation. Yet, they rely on a critical assumption: Teacher and Student must inha…
Improved Training Technique for Shortcut Models
Anh Nguyen, Viet Nguyen, Duc Vu +4
Shortcut models represent a promising, non-adversarial paradigm for generative modeling, uniquely supporting one-step, few-step, and multi-step sampling from a single trained netwo…
AccurateRAG: A Framework for Building Accurate Retrieval-Augmented Question-Answering Applications
Linh The Nguyen, Chi Tran, Dung Ngoc Nguyen +3
We introduce AccurateRAG -- a novel framework for constructing high-performance question-answering applications based on retrieval-augmented generation (RAG). Our framework offers…
LaVy: Vietnamese Multimodal Large Language Model
Chi Tran, Huong Le Thanh
Large Language Models (LLMs) and Multimodal Large language models (MLLMs) have taken the world by storm with impressive abilities in complex reasoning and linguistic comprehension.…
PhoGPT: Generative Pre-training for Vietnamese
Dat Quoc Nguyen, Linh The Nguyen, Chi Tran +3
We open-source a state-of-the-art 4B-parameter generative model series for Vietnamese, which includes the base pre-trained monolingual model PhoGPT-4B and its chat variant, PhoGPT-…