6 papers · 1 filter
Reflective Compositional Grounding for Natural-Language-to-SPARQL
Isabelle Mohr, John Dujany, Andre Freitas
Natural-language query generation over large knowledge graphs embodies the classical vocabulary problem in human-systems communication. Questions express concepts through wording a…
World Modeling in Transformers
Pierre Beckmann, Matthieu Queloz, Andre Freitas
Behavioral failures can make a transformer appear to lack a world model even when it has learned faithful representations of its environment. We demonstrate this in TaxiGPT, a tran…
Align, Unify, Suppress, Route: A Coherentist View of Transformer Computation
Nura Aljaafari, Andre Freitas
Mechanistic interpretability has identified transformer circuits, but lacks a shared vocabulary for describing how their functions compose across tasks and architectures. We introd…
Principles of Concept Representation in Sentence Encoders
Isabelle Mohr, John Dujany, Jonathan Souquet +1
What makes a sentence encoder produce good concept representations? We approach this through the lens of representational compositionality: an encoder supports a concept family onl…
From Circuit Evidence to Mechanistic Theory: An Inductive Logic Approach
Nura Aljaafari, Danilo S. Carvalho, Andre Freitas
Mechanistic interpretability produces circuit-level causal analyses of neural network behaviour, but discovered circuits often remain isolated experimental artefacts: there is no s…
Reflective Reasoning for SQL Generation
Isabelle Mohr, Joao Gandarela, John Dujany +1
Robust text-to-SQL over complex, real-world databases remains brittle even with modern LLMs: iterative refinement often introduces syntactic and semantic drift, corrections tend to…