4 papers · 1 filter
Reasoning Errors Have a Region and a Direction in the Residual-Stream Trajectory of LLMs
Hamed Damirchi, Ignacio Meza De la Jara, Damith Ranasinghe +2
As language models are increasingly used for tasks that require verifiable reasoning, reliably distinguishing sound reasoning from flawed reasoning has become an important practica…
Representation Trajectories Matters: Complementary Evidence for OOD Detection and Image Classification
Ignacio M. De la Jara, Cristian Rodriguez-Opazo, Hamed Damirchi +2
Vision models do not form a representation at once; each block revises it. We ask whether the resulting computation path contains evidence that the final representation discards, a…
Vertical Fusion: Condensing Internal Representations for Robust ViT Classification
Francesco Di Salvo, Shyam Nandan Rai, Hamed Damirchi +4
Despite exposing rich intermediate representations, Vision Transformers (ViTs) are almost exclusively utilized as black-box feature extractors, where only the last layer is conside…
Truth as a Trajectory: What Internal Representations Reveal About Large Language Model Reasoning
Hamed Damirchi, Ignacio Meza De la Jara, Ehsan Abbasnejad +3
Existing explainability methods for Large Language Models (LLMs) typically treat hidden states as static points in activation space, assuming that correct and incorrect inferences…