4 papers
Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts
Nikolaos Xiros, Dimitrios Damianos, Maria-Eleni Zoumpoulidi +3
In current Mixture-of-Experts architectures, routing is performed based on representations dominated by structure shared across all tokens, limiting expert specialization. We show…
More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs
Maria-Eleni Zoumpoulidi, Nikolaos Xiros, Georgios Paraskevopoulos
Solvability detection is one of the most challenging aspects of mathematical reasoning for Large Language Models (LLMs). While prior work has studied this capability extensively, t…
Segregate, Refine, Integrate: Decomposing Multimodal Fusion for Sentiment Analysis
Alexios Filippakopoulos, Elias Kallioras, Nikolaos Xiros +2
Multimodal fusion must simultaneously refine modality-specific signals and model cross-modal interactions; two competing objectives typically entangled within the same operation. W…
Knowledge Knows, Verbalization Tells: Disentangling Latent Directions for Mathematical Solvability in LLMs
Nikolaos Xiros, Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos
Although LLMs have made significant progress in mathematical reasoning, determining whether a mathematical problem is solvable remains a fundamental yet challenging capability. Whi…