Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
An Exploratory Ablation of a Small MLA--SSM Hybrid Language Model
Christos Koutsiaris
We report an exploratory, single-seed ablation of TALH (Adaptive Latent Hybrid), a decoder-only language model with parallel Multi-head Latent Attention (MLA) and a custom recurren…
cs.CL2026
Nested Byte-Level Vocabularies Are Cheap to Deploy and Expensive to Share: A Pre-Registered Negative Result
Christos Koutsiaris
A byte-level BPE tokenizer is an ordered list of merge rules, so applying only a prefix yields a vocabulary whose token identifiers are the first rows of the full vocabulary. This…