1 citations · 2 across the 5 of their papers we have counts for
4 papers · 1 filter
Polar probe linearly decodes semantic structures from LLMs
Pablo J. Diego-Simón, Pierre Orhan, Emmanuel Chemla +2
How do artificial neural networks bind concepts to form complex semantic structures? Here, we propose a simple neural code, whereby the existence and the type of relations between…
Probing Syntax in Large Language Models: Successes and Remaining Challenges
Pablo J. Diego-Simón, Emmanuel Chemla, Jean-Rémi King +1
The syntactic structures of sentences can be readily read-out from the activations of large language models (LLMs). However, the ``structural probes'' that have been developed to r…
A polar coordinate system represents syntax in large language models
Pablo Diego-Simón, Stéphane D'Ascoli, Emmanuel Chemla +2
Originally formalized with symbolic representations, syntactic trees may also be effectively represented in the activations of large language models (LLMs). Indeed, a 'Structural P…
XLS-R fine-tuning on noisy word boundaries for unsupervised speech segmentation into words
Robin Algayres, Pablo Diego-Simon, Benoit Sagot +1
Due to the absence of explicit word boundaries in the speech stream, the task of segmenting spoken sentences into word units without text supervision is particularly challenging. I…