3 papers
stat.ML2026
ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models
Quang Hoang Trung, Quang Huu Hieu, Nguyen Van Hoang Phuc +1
Logit-based knowledge distillation for autoregressive language models usually aligns teacher and student next-token distributions over the entire vocabulary. However, this global o…
cs.IR2024
Optimizing Multi-Stage Language Models for Effective Text Retrieval
Quang Hoang Trung, Le Trung Hoang, Nguyen Van Hoang Phuc
Efficient text retrieval is critical for applications such as legal document analysis, particularly in specialized contexts like Japanese legal systems. Existing retrieval methods…
cs.IR2024
Adaptive Two-Phase Finetuning LLMs for Japanese Legal Text Retrieval
Quang Hoang Trung, Nguyen Van Hoang Phuc, Le Trung Hoang +2
Text Retrieval (TR) involves finding and retrieving text-based content relevant to a user's query from a large repository, with applications in real-world scenarios such as legal d…