22 citations · 108 across the 43 of their papers we have counts for
3 papers · 1 filter
Attention-Aware Routing: Coupling Routing and Attention in MoEs
Despoina Kosmopoulou, Anastasios Tsetsilas, Efthymios Georgiou +3
In Mixture-of-Experts language models, the router typically selects and weights experts based on the token's hidden state, utilizing limited contextual information. We propose Atte…
Cognitive Profiling of LRMs' Reasoning Traces Using Bloom's Taxonomy
Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos
Large Reasoning Models (LRMs) have revolutionized reasoning in LLMs, and the increasing public availability of reasoning traces creates valuable opportunities to study model behavi…
Semantic F1 Scores: Fair Evaluation Under Fuzzy Class Boundaries
Georgios Chochlakis, Jackson Trager, Vedant Jhaveri +3
We propose Semantic F1 Scores, novel evaluation metrics for subjective or fuzzy multi-label classification that quantify semantic relatedness between predicted and gold labels. Unl…