1 citations · 2 across the 11 of their papers we have counts for
16 papers
Representation of syntax in LLMs through the lens of linear distance and similarity-aware entropy
Juan Pablo Vigneaux, Mary Kennedy, Khalil Iskarous +2
Structural probes were introduced by Hewitt and Manning to reconstruct syntactic trees from a neural language model's latent representations. They are evaluated by calculating the…
Probing neural audio codecs for distinctions among English nuclear tunes
Juan Pablo Vigneaux, Jennifer Cole
State-of-the-art spoken dialogue models (Défossez et al. 2024; Schalkwyk et al. 2025) use neural audio codecs to "tokenize" audio signals into a lower-frequency stream of vectorial…
Entropies associated with orbits of finite groups
Ryan Leal, Jingtong Sun, Juan Pablo Vigneaux
For certain groups, parabolic subgroups appear as stabilizers of flags of sets or vector spaces. Quotients by these parabolic subgroups represent orbits of flags, and their cardina…
The magnitude of categories of texts enriched by language models
Tai-Danae Bradley, Juan Pablo Vigneaux
The purpose of this article is twofold. Firstly, we use the next-token probabilities given by a language model to explicitly define a category of texts in natural language enriched…
A combinatorial approach to categorical Möbius inversion and pseudoinversion
Juan Pablo Vigneaux
We use Cramer's formula for the inverse of a matrix and a combinatorial expression for the determinant in terms of paths of an associated digraph (which can be traced back to Coate…
On the entropy of rectifiable and stratified measures
Juan Pablo Vigneaux
We summarize some results of geometric measure theory concerning rectifiable sets and measures. Combined with the entropic chain rule for disintegrations (Vigneaux, 2021), they acc…