3 papers
cs.LG2026
Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams
Siddharth Pal, Viktoria Rojkova
Context engineering decides what information a model carries forward, and current designs meter it in tokens: compressing the past into a bounded recurrent state, keeping a key-val…
cs.LG2026
Remembering Distinct Items, Not Tokens: A Learnable Dirichlet-Process Cache Between State-Space Models and Attention
Siddharth Pal, Viktoria Rojkova
Fixed-state sequence models compress an unbounded past into a bounded state, which caps their associative recall at roughly the state dimension; attention escapes the cap by keepin…
cs.LG2026
A Stationarity-and-Coupling Criterion for Training-Free Time-Lagged Spectral Embeddings of Multivariate Time Series
Siddharth Pal, Viktoria Rojkova
We study training-free fixed-length descriptors for multivariate time series and ask not merely whether such a descriptor performs well, but when it can be expected to work at all.…