6 papers
VL-RouterBench: A Benchmark for Vision-Language Model Routing
Zhehao Huang, Baijiong Lin, Jingyuan Zhang +5
Multi-model routing has evolved from an engineering technique into essential infrastructure, yet existing work lacks a systematic, reproducible benchmark for evaluating vision-lang…
Attention to details, logits to truth: visual-aware attention and logits enhancement to mitigate hallucinations in LVLMs
Jingyi Wang, Fei Li, Rujie Liu
Existing Large Vision-Language Models (LVLMs) exhibit insufficient visual attention, leading to hallucinations. To alleviate this problem, some previous studies adjust and amplify…
PromptFlow: Training Prompts Like Neural Networks
Jingyi Wang, Hongyuan Zhu, Ye Niu +1
Large Language Models (LLMs) have demonstrated profound impact on Natural Language Processing (NLP) tasks. However, their effective deployment across diverse domains often require…
Rounding-Guided Backdoor Injection in Deep Learning Model Quantization
Xiangxiang Chen, Peixin Zhang, Jun Sun +2
Model quantization is a popular technique for deploying deep learning models on resource-constrained environments. However, it may also introduce previously overlooked security ris…
Blind Spot Navigation: Evolutionary Discovery of Sensitive Semantic Concepts for LVLMs
Zihao Pan, Yu Tong, Weibin Wu +6
Adversarial attacks aim to generate malicious inputs that mislead deep models, but beyond causing model failure, they cannot provide certain interpretable information such as ``\te…
RedTest: Towards Measuring Redundancy in Deep Neural Networks Effectively
Yao Lu, Peixin Zhang, Jingyi Wang +3
Deep learning has revolutionized computing in many real-world applications, arguably due to its remarkable performance and extreme convenience as an end-to-end solution. However, d…