Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
An Information-Theoretic Criterion for Efficient Data Synthesis
Hanyu Li, Zhengqi Sun, Xiaotie Deng
Synthetic data becomes crucial for large language model training, but its effectiveness is highly inconsistent. We provide an information-theoretic account of this inconsistency: s…
cs.LG2025
TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks
Yuanze Hu, Zhaoxin Fan, Xinyu Wang +8
Lightweight Vision-Language Models (VLMs) are indispensable for resource-constrained applications. The prevailing approach to aligning vision and language models involves freezing…