4 papers
Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning
Hao Yang, Jin Wang, Xuejie Zhang
Multimodal chain-of-thought (CoT) reasoning integrates visual and textual cues through step-by-step inference. In small models with limited token budgets, modality-interaction fusi…
LLMdoctor: Token-Level Flow-Guided Preference Optimization for Efficient Test-Time Alignment of Large Language Models
Tiesunlong Shen, Rui Mao, Jin Wang +4
Aligning Large Language Models (LLMs) with human preferences is critical, yet traditional fine-tuning methods are computationally expensive and inflexible. While test-time alignmen…
Learning to Reason via Self-Iterative Process Feedback for Small Language Models
Kaiyuan Chen, Jin Wang, Xuejie Zhang
Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning…
Personalized LoRA for Human-Centered Text Understanding
You Zhang, Jin Wang, Liang-Chih Yu +2
Effectively and efficiently adapting a pre-trained language model (PLM) for human-centered text understanding (HCTU) is challenging since user tokens are million-level in most pers…