1 citations · 2 across the 7 of their papers we have counts for
8 papers
Robot World Models Are Not Invariant to How the Actions Are Written
Ahmed Karim, Leon Chlon
A robot policy is trained with one of two action parameterizations: absolute joint targets, or deltas relative to the current state. The choice is a live engineering decision in ro…
Exact Finite Attention Responses From RoPE Derivatives
Julie Huang, Maggie Chlon, Gregory Gutin +1
We derive exact local responses for attention interventions, allowing candidate edits to be scored from a cached baseline and one backward pass. The starting point is the RoPE deri…
RoPE attention is an exact forward-pass gradient step with softmax intact
Julie Huang, Maggie Chlon, Leon Chlon
We derive an exact gradient-step representation of the RoPE-softmax forward pass. For every deterministic RoPE-softmax attention head with arbitrary affine projection weights, we c…
Attention Deficits in Language Models: Causal Explanations for Procedural Hallucinations
Ahmed Karim, Fatima Sheaib, Zein Khamis +3
Large language models can follow complex procedures yet fail at a seemingly trivial final step: reporting a value they themselves computed moments earlier. We study this phenomenon…
Predictable Compression Failures: Order Sensitivity and Information Budgeting for Evidence-Grounded Binary Adjudication
Leon Chlon, Ahmed Karim, Maggie Chlon +1
Transformers used for evidence-grounded binary adjudication (e.g., support/refute, yes/no, or verifier-backed pass/fail decisions) can be sensitive to the order in which exchangeab…
LLMs are Bayesian, In Expectation, Not in Realization
Leon Chlon, Fatima Sheaib, Zein Khamis +3
Bayesian accounts of in-context learning face a direct objection: exact posterior predictives for exchangeable data are invariant to task-preserving order, yet transformers change…
Robust Multimodal Learning via Entropy-Gated Contrastive Fusion
Leon Chlon, Maggie Chlon, MarcAntonio M. Awada
Real-world multimodal systems routinely face missing-input scenarios, and in reality, robots lose audio in a factory or a clinical record omits lab tests at inference time. Standar…
Multitaper Spectral Estimation HDP-HMMs for EEG Sleep Inference
Leon Chlon, Andrew Song, Sandya Subramanian +4
Electroencephalographic (EEG) monitoring of neural activity is widely used for sleep disorder diagnostics and research. The standard of care is to manually classify 30-second epoch…