7 papers
Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models
Hongjian Zou, Yidan Wang, Qi Ding +2
Large language models often achieve strong benchmark gains without corresponding improvements in broader capability. We hypothesize that this discrepancy arises from differences in…
Caption First, VQA Second: Knowledge Density, Not Task Format, Drives Multimodal Scaling
Hongjian Zou, Yue Ge, Qi Ding +2
Multimodal large language models (MLLMs) have achieved rapid progress, yet their scaling behavior remains less clearly characterized and often less predictable than that of text-on…
Bi-directional Bias Attribution: Debiasing Large Language Models without Modifying Prompts
Yujie Lin, Kunquan Li, Yixuan Liao +2
Large language models (LLMs) have demonstrated impressive capabilities across a wide range of natural language processing tasks. However, their outputs often exhibit social biases,…
Predictive Data Selection: The Data That Predicts Is the Data That Teaches
Kashun Shum, Yuzhen Huang, Hongjian Zou +5
Language model pretraining involves training on extensive corpora, where data quality plays a pivotal role. In this work, we aim to directly estimate the contribution of data durin…
A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models
Zhihao Wang, Shiyu Liu, Jianheng Huang +5
Due to the continuous emergence of new data, version updates have become an indispensable requirement for Large Language Models (LLMs). The training paradigms for version updates o…
DPL: Decoupled Prompt Learning for Vision-Language Models
Chen Xu, Yuhan Zhu, Guozhen Zhang +5
Prompt learning has emerged as an efficient and effective approach for transferring foundational Vision-Language Models (e.g., CLIP) to downstream tasks. However, current methods t…
Progressive Visual Prompt Learning with Contrastive Feature Re-formation
Chen Xu, Yuhan Zhu, Haocheng Shen +4
Prompt learning has been designed as an alternative to fine-tuning for adapting Vision-language (V-L) models to the downstream tasks. Previous works mainly focus on text prompt whi…