Showing cs.ITShow all
3 papers · 1 filter
cs.IT2026
An Information-Theoretic Perspective on LLM Tokenizers
Mete Erdogan, Abhiram Gorle, Shubham Chandak +2
Large language model (LLM) tokenizers act as structured compressors: by mapping text to discrete token sequences, they determine token count (and thus compute and context usage) an…
cs.IT2025
Information-computation trade-offs in non-linear transforms
Connor Ding, Abhiram Rao Gorle, Jiwon Jeong +2
In this work, we explore the interplay between information and computation in non-linear transform-based compression for broad classes of modern information-processing tasks. We fi…
cs.IT2025
An Information-Theoretic Efficient Capacity Region for Multi-User Interference Channel
Sagnik Bhattacharya, Abhiram Rao Gorle, Muhammad Ali Mohsin +1
We investigate the capacity region of multi-user interference channels (IC), where each user encodes multiple sub-user components. By unifying chain-rule decomposition with the Ent…