6 citations · 8 across the 3 of their papers we have counts for
3 papers
cs.CL2024★ 2 cited
On the Origins of Linear Representations in Large Language Models
Yibo Jiang, Goutham Rajendran, Pradeep Ravikumar +2
Recent works have argued that high-level semantic concepts are encoded "linearly" in the representation space of large language models. In this work, we study the origins of such l…
cs.LG2023
Uncovering Meanings of Embeddings via Partial Orthogonality
Yibo Jiang, Bryon Aragam, Victor Veitch
Machine learning tools often rely on embedding text as vectors of real numbers. In this paper, we study how the semantic structure of language is encoded in the algebraic structure…
cs.LG2022★ 6 cited
Invariant and Transportable Representations for Anti-Causal Domain Shifts
Yibo Jiang, Victor Veitch
Real-world classification problems must contend with domain shift, the (potential) mismatch between the domain where a model is deployed and the domain(s) where the training data w…