From the 1 of 4 linked papers with an AI index.
4 papers
REAL: Reading Out Transformer Activations for Precise Localization in Language Model Steering
Li-Ming Zhan, Bo Liu, Chengqiang Xie +2
The paper introduces REAL, a method that trains vector-quantized autoencoders on transformer activations to pinpoint attention heads or layers that most influence a target behavior…
GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosis
Bo Liu, Ke Zou, Liming Zhan +7
Medical Visual Question Answering (Med-VQA) combines computer vision and natural language processing to automatically answer clinical inquiries about medical images. However, curre…
KIF: Knowledge Identification and Fusion for Language Model Continual Learning
Yujie Feng, Xu Chu, Yongxin Xu +4
Language model continual learning (CL) has recently attracted significant interest for its ability to adapt large language models (LLMs) to dynamic real-world scenarios without ret…
Continual Dialogue State Tracking via Reason-of-Select Distillation
Yujie Feng, Bo Liu, Xiaoyu Dong +4
An ideal dialogue system requires continuous skill acquisition and adaptation to new tasks while retaining prior knowledge. Dialogue State Tracking (DST), vital in these systems, o…