4 citations · 10 across the 9 of their papers we have counts for
5 papers · 1 filter
Local Causal Attribution of Chain-of-Thought Reasoning
Dennis Wei, Yannis Belkhiter, Erik Miehling +1
Understanding the causal structure of a language model's thought process is a problem of significant importance for both transparency and safety. In this work, we take a local appr…
Multi-component Causal Tracing in Large Language Models
Zirui Yan, Dennis Wei, Dmitriy A. Katz +2
Causal tracing systematically intervenes on a large language model's (LLM's) internal representations to uncover and quantify the causal pathways linking specific inputs or computa…
Entropy-Aware On-Policy Distillation of Language Models
Woogyeol Jin, Taywon Min, Yongjin Yang +5
On-policy distillation is a promising approach for transferring knowledge between language models, where a student learns from dense token-level signals along its own trajectories.…
Detectors for Safe and Reliable LLMs: Implementations, Uses, and Limitations
Swapnaja Achintalwar, Adriana Alvarado Garcia, Ateret Anaby-Tavor +35
Large language models (LLMs) are susceptible to a variety of risks, from non-faithful output to biased and toxic generations. Due to several limiting factors surrounding LLMs (trai…
Effective Human-AI Teams via Learned Natural Language Rules and Onboarding
Hussein Mozannar, Jimin J Lee, Dennis Wei +3
People are relying on AI agents to assist them with various tasks. The human must know when to rely on the agent, collaborate with the agent, or ignore its suggestions. In this wor…