4 papers
Benchmark Shadows: Data Alignment, Parameter Footprints, and Generalization in Large Language Models
Hongjian Zou, Yidan Wang, Qi Ding +2
Large language models often achieve strong benchmark gains without corresponding improvements in broader capability. We hypothesize that this discrepancy arises from differences in…
Caption First, VQA Second: Knowledge Density, Not Task Format, Drives Multimodal Scaling
Hongjian Zou, Yue Ge, Qi Ding +2
Multimodal large language models (MLLMs) have achieved rapid progress, yet their scaling behavior remains less clearly characterized and often less predictable than that of text-on…
Predictive Data Selection: The Data That Predicts Is the Data That Teaches
Kashun Shum, Yuzhen Huang, Hongjian Zou +5
Language model pretraining involves training on extensive corpora, where data quality plays a pivotal role. In this work, we aim to directly estimate the contribution of data durin…
BlueLM-2.5-3B Technical Report
Baojiao Xiong, Boheng Chen, Chengzhi Wang +58
We present BlueLM-2.5-3B, a compact and unified dense Multimodal Large Language Model (MLLM) designed for efficient edge-device deployment, offering strong general-purpose and reas…