3 papers
cs.CL2026
Diffusion-Inspired Masked Fine-Tuning for Knowledge Injection in Autoregressive LLMs
Xu Pan, Ely Hahami, Jingxuan Fan +2
Large language models (LLMs) are often used in environments where facts evolve, yet factual knowledge updates via fine-tuning on unstructured text often suffer from 1) reliance on…
cs.CL2026
User-Assistant Bias in LLMs
Xu Pan, Jingxuan Fan, Zidi Xiong +3
Modern large language models (LLMs) are typically trained and deployed using structured role tags (e.g. system, user, assistant, tool) that explicitly mark the source of each piece…
cs.CV2025
Dissecting Query-Key Interaction in Vision Transformers
Xu Pan, Aaron Philip, Ziqian Xie +1
Self-attention in vision transformers is often thought to perform perceptual grouping where tokens attend to other tokens with similar embeddings, which could correspond to semanti…