2 citations · 5 across the 17 of their papers we have counts for
4 papers · 1 filter
Locality Matters for Training-Free Audio Token Compression in Audio-Language Models
Jiale Luo, Xiaoyu Liang, Haoji Hu
Audio-language models (ALMs) are increasingly used for audio captioning, question answering, and open-ended audio understanding, but their inference cost remains high when audio in…
D3S2: Diffusion-Guided Dataset Distillation for Semantic Segmentation
Wenjie Zheng, Haoji Hu, Jiali Lu +2
Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic sets while preserving training efficacy. However, existing studies mainly focus on image clas…
Q Cache: Visual Attention is Valuable in Less than Half of Decode Layers for Multimodal Large Language Model
Jiedong Zhuang, Lu Lu, Ming Dai +4
Multimodal large language models (MLLMs) are plagued by exorbitant inference costs attributable to the profusion of visual tokens within the vision encoder. The redundant visual to…
Learn Before Represent: Bridging Generative and Contrastive Learning for Domain-Specific LLM Embeddings
Xiaoyu Liang, Yuchen Peng, Jiale Luo +3
Large Language Models (LLMs) adapted via contrastive learning excel in general representation learning but struggle in vertical domains like chemistry and law, primarily due to a l…