3 citations · 6 across the 10 of their papers we have counts for
10 papers
Steering to Say No: Configurable Refusal via Activation Steering in Vision Language Models
Jiaxi Yang, Shicheng Liu, Yuchen Yang +1
With the rapid advancement of Vision Language Models (VLMs), refusal mechanisms have become a critical component for ensuring responsible and safe model behavior. However, existing…
MAGE: Multimodal Alignment and Generation Enhancement via Bridging Visual and Semantic Spaces
Shaojun E, Yuchen Yang, Jiaheng Wu +3
In the latest advancements in multimodal learning, effectively addressing the spatial and semantic losses of visual data after encoding remains a critical challenge. This is becaus…
Jailbreaking Safeguarded Text-to-Image Models via Large Language Models
Zhengyuan Jiang, Yuepeng Hu, Yuchen Yang +2
Text-to-Image models may generate harmful content, such as pornographic images, particularly when unsafe prompts are submitted. To address this issue, safety filters are often adde…
HAUR: Human Annotation Understanding and Recognition Through Text-Heavy Images
Yuchen Yang, Haoran Yan, Yanhao Chen +2
Vision Question Answering (VQA) tasks use images to convey critical information to answer text-based questions, which is one of the most common forms of question answering in real-…
RIPPLECOT: Amplifying Ripple Effect of Knowledge Editing in Language Models via Chain-of-Thought In-Context Learning
Zihao Zhao, Yuchen Yang, Yijiang Li +1
The ripple effect poses a significant challenge in knowledge editing for large language models. Namely, when a single fact is edited, the model struggles to accurately update the r…
ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNs
Yuchen Yang, Yifan Zhao, Shubham Ugare +2
Mixed precision quantization has become an important technique for optimizing the execution of deep neural networks (DNNs). Certified robustness, which provides provable guarantees…
Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models
Yuchen Yang, Kwonjoon Lee, Behzad Dariush +2
Video Anomaly Detection (VAD) is crucial for applications such as security surveillance and autonomous driving. However, existing VAD methods provide little rationale behind detect…
Towards Scale-Aware Full Surround Monodepth with Transformers
Yuchen Yang, Xinyi Wang, Dong Li +3
Full surround monodepth (FSM) methods can learn from multiple camera views simultaneously in a self-supervised manner to predict the scale-aware depth, which is more practical for…
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
Yuchen Yang, Yingdong Shi, Cheems Wang +3
Fine-tuning pretrained large models to downstream tasks is an important problem, which however suffers from huge memory overhead due to large-scale parameters. This work strives to…
SneakyPrompt: Jailbreaking Text-to-image Generative Models
Yuchen Yang, Bo Hui, Haolin Yuan +2
Text-to-image generative models such as Stable Diffusion and DALLE raise many ethical concerns due to the generation of harmful images such as Not-Safe-for-Work (NSFW) ones.…