6 citations · 6 across the 8 of their papers we have counts for
4 papers · 1 filter
Understanding and Mitigating Hallucination Escape in Tool-Using LLM Agents
Peigui Qi, Kunsheng Tang, Yide Song +2
Large language models (LLMs) increasingly serve as autonomous agents that invoke external tools. However, this capability introduces tool hallucination, selecting incorrect tools o…
GlitchPatch: Repairing Glitch Tokens in Frozen Language Models via Local Retokenization
Kunsheng Tang, Peigui Qi, Yide Song +3
Glitch tokens are anomalous vocabulary entries that can cause large language models (LLMs) to produce outputs inconsistent with their inputs. Existing repair methods require access…
VLMShield: Efficient and Robust Defense of Vision-Language Models against Malicious Prompts
Peigui Qi, Kunsheng Tang, Yanpu Yu +7
Vision-Language Models (VLMs) face significant safety vulnerabilities from malicious prompt attacks due to weakened alignment during visual integration. Existing defenses suffer fr…
Revis: Sparse Latent Steering to Mitigate Object Hallucination in Large Vision-Language Models
Jialin Wu, Wei Shi, Han Shen +5
Despite the advanced capabilities of Large Vision-Language Models (LVLMs), they frequently suffer from object hallucination. One reason is that visual features and pretrained textu…