9 papers
Surrogate Fidelity: When Can Open LLMs Explain Closed Ones?
Philippe Chlenski, Zachariah Carmichael, Ayush Warikoo +5
Mechanistic interpretability (MI) requires full access to model internals, yet the APIs for most widely deployed language models at best expose log-probabilities over output tokens…
Objective-Specific Privileged Bases via Full-Prefix Matryoshka Learning
Arghamitra Talukder, Philippe Chlenski, Itsik Pe'er
Learned representations are often invariant to rotational transformations, leaving individual dimensions non-identifiable and interchangeable. We study how Matryoshka Representatio…
Hyperbolic Genome Embeddings
Raiyan R. Khan, Philippe Chlenski, Itsik Pe'er
Current approaches to genomic sequence modeling often struggle to align the inductive biases of machine learning models with the evolutionarily-informed structure of biological sys…
Manify: A Python Library for Learning Non-Euclidean Representations
Philippe Chlenski, Kaizhu Du, Dylan Satow +2
We present Manify, an open-source Python library for non-Euclidean representation learning. Leveraging manifold learning techniques, Manify provides tools for learning embeddings i…
Mixed-curvature decision trees and random forests
Philippe Chlenski, Quentin Chu, Raiyan R. Khan +3
Decision trees (DTs) and their random forest (RF) extensions are workhorses of classification and regression in Euclidean spaces. However, algorithms for learning in non-Euclidean…
Even Faster Hyperbolic Random Forests: A Beltrami-Klein Wrapper Approach
Philippe Chlenski, Itsik Pe'er
Decision trees and models that use them as primitives are workhorses of machine learning in Euclidean spaces. Recent work has further extended these models to the Lorentz model of…