4 papers
ES-VP : Energy-Shaped Dynamic Visual Prompting for Efficient Model Adaptation
Can Jin, Ying Li, Jingchen Sun +5
Visual prompting (VP) has emerged as a parameter-efficient method for adapting pre-trained models to downstream tasks. However, existing approaches encounter a trade-off between fl…
Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
Chengwen Liu, Zhe Huang, Jisheng Dang +3
Reinforcement learning has improved the reasoning ability of large language models, but applying outcome-only rewards to video multimodal large language models (Video-MLLMs) provid…
Reasoning over Precedents Alongside Statutes: Case-Augmented Deliberative Alignment for LLM Safety
Can Jin, Rui Wu, Tong Che +10
Ensuring that Large Language Models (LLMs) adhere to safety principles without refusing benign requests remains a significant challenge. While OpenAI introduces deliberative alignm…
RankFlow: A Multi-Role Collaborative Reranking Workflow Utilizing Large Language Models
Can Jin, Hongwu Peng, Anxiang Zhang +8
In an Information Retrieval (IR) system, reranking plays a critical role by sorting candidate passages according to their relevance to a specific query. This process demands a nuan…