12 papers
Induction in Both Directions: A Mechanistic Analysis of In-Context Learning in Masked Diffusion Language Models
Andy Catruna, Emilian Radoi
While the internal mechanisms of autoregressive (AR) transformers have been studied extensively, much less is known about diffusion language models (DLMs), an emerging alternative…
Improving Medical Communication using Rubric-Guided Counterfactual Recommendations
Adrian Cosma, Nicoleta-Nina Basoc, Andrei Niculae +2
Text-based telemedicine increasingly relies on lightweight patient feedback, however, such feedback primarily reflects perceived communication quality rather than medical accuracy.…
What Makes a Good Doctor Response? A Study on Text-Based Telemedicine
Adrian Cosma, Cosmin Dumitrache, Emilian Radoi
Text-based telemedicine has become an increasingly used mode of care, requiring clinicians to deliver medical advice clearly and effectively in writing. As platforms increasingly r…
Spatial Colour Mixing Illusions as a Perception Stress Test for Vision-Language Models
Nicoleta-Nina Basoc, Adrian Cosma, Emilian Radoi
Vision-language models (VLMs) achieve strong benchmark results, yet can exhibit systematic perceptual weaknesses: structured, large changes to pixel values can cause confident yet…
Training Language Models with homotokens Leads to Delayed Overfitting
Adrian Cosma, Stefan Ruseti, Emilian Radoi +1
Subword tokenization introduces a computational layer in language models where many distinct token sequences decode to the same surface form and preserve meaning, yet induce differ…
MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts
Andy CÇtrunÇ, Adrian Cosma, Emilian RÇdoi
Gait encodes rich biometric and behavioural information, yet leveraging the manner of walking to infer psychological traits remains a challenging and underexplored problem. We intr…