5 papers
Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts
Nikolaos Xiros, Dimitrios Damianos, Maria-Eleni Zoumpoulidi +3
In current Mixture-of-Experts architectures, routing is performed based on representations dominated by structure shared across all tokens, limiting expert specialization. We show…
More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs
Maria-Eleni Zoumpoulidi, Nikolaos Xiros, Georgios Paraskevopoulos
Solvability detection is one of the most challenging aspects of mathematical reasoning for Large Language Models (LLMs). While prior work has studied this capability extensively, t…
Cognitive Profiling of LRMs' Reasoning Traces Using Bloom's Taxonomy
Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos
Large Reasoning Models (LRMs) have revolutionized reasoning in LLMs, and the increasing public availability of reasoning traces creates valuable opportunities to study model behavi…
Knowledge Knows, Verbalization Tells: Disentangling Latent Directions for Mathematical Solvability in LLMs
Nikolaos Xiros, Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos
Although LLMs have made significant progress in mathematical reasoning, determining whether a mathematical problem is solvable remains a fundamental yet challenging capability. Whi…
BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts
Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos
Despite the remarkable capabilities of large language models (LLMs) across a range of tasks, mathematical reasoning remains a challenging frontier. Motivated by the observation tha…