3 papers
cs.AI2026
Thomson: Continual Learning of Frontier Models for SovereignAI
Shengzhuang Chen, Jerrod Parker, Yejin Bang +23
The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetr…
cs.AI2026
TreeWY: Speculative Verification for Gated DeltaNet Hybrids
Sneha Murthy Ghantasala
Modern open models are hybrids: most layers are linear-attention (Gated DeltaNet, GDN) layers carrying a small fixed-size recurrent state instead of a growing key-value (KV) cache.…
cs.CL2023
Legal-HNet: Mixing Legal Long-Context Tokens with Hartley Transform
Daniele Giofré, Sneha Ghantasala
Since its introduction, the transformers architecture has seen great adoption in NLP applications, but it also has limitations. Although the self-attention mechanism allows for gen…