12 papers
The Performance of Compression-Based Denoisers
Dan Song, Ayfer Ãzgür, Tsachy Weissman
We consider a denoiser that reconstructs a stationary ergodic source by lossily compressing samples of the source observed through a memoryless noisy channel. Prior work on compres…
Agent Memory: Characterization and System Implications of Stateful Long-Horizon Workloads
Yasmine Omri, Ziyu Gan, Zachary Broveak +6
LLM agents are increasingly deployed on long-horizon tasks requiring sustained reasoning over extended interaction histories. Realizing this at scale requires agents to persistentl…
Quantum sensing with a spin ensemble in a two-dimensional material
Souvik Biswas, Giovanni Scuri, Noah Huffman +12
Quantum sensing with solid-state spin defects has transformed nanoscale metrology, offering sub-wavelength spatial resolution with exceptional sensitivity to multiple signal types.…
The LZ78 Source
Naomi Sagan, Amir Dembo, Matthew Ho +1
We study a family of processes generated according to sequential probability assignments induced by the LZ78 universal compressor. We characterize entropic and distributional prope…
ItDPDM: Information-Theoretic Discrete Poisson Diffusion Model
Sagnik Bhattacharya, Abhiram Gorle, Ahsan Bilal +3
Generative modeling of non-negative, discrete data, such as symbolic music, remains challenging due to two persistent limitations in existing methods. Firstly, many approaches rely…
An Information-Theoretic Perspective on LLM Tokenizers
Mete Erdogan, Abhiram Gorle, Shubham Chandak +2
Large language model (LLM) tokenizers act as structured compressors: by mapping text to discrete token sequences, they determine token count (and thus compute and context usage) an…