4 papers
From Hallucination to Grounding: Diagnosing Visual Spatial Intelligence via CRISP
Zhixing Li, Yinan Yu
Current VLM evaluations often conflate language priors with genuine spatial reasoning. To address this, we introduce CRISP, a novel structural-diagnostic evaluation paradigm that a…
Latent Domain Prompt Learning for Vision-Language Models
Zhixing Li, Arsham Gholamzadeh Khoee, Yinan Yu
The objective of domain generalization (DG) is to enable models to be robust against domain shift. DG is crucial for deploying vision-language models (VLMs) in real-world applicati…
JailPO: A Novel Black-box Jailbreak Framework via Preference Optimization against Aligned LLMs
Hongyi Li, Jiawei Ye, Jie Wu +3
Large Language Models (LLMs) aligned with human feedback have recently garnered significant attention. However, it remains vulnerable to jailbreak attacks, where adversaries manipu…
Optimizing and Fine-tuning Large Language Model for Urban Renewal
Xi Wang, Xianyao Ling, Tom Zhang +5
This study aims to innovatively explore adaptive applications of large language models (LLM) in urban renewal. It also aims to improve its performance and text generation quality f…