5 papers
The Twelvefold Way of Non-Sequential Lossless Compression
Taha Ameen ur Rahman, Alton S. Barbehenn, Xinan Chen +27
Many information sources are not just sequences of distinguishable symbols but rather have invariances governed by alternative counting paradigms such as permutations, combinations…
Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity
Sourya Basu, Govardana Sachitanandam Ramachandran, Nitish Shirish Keskar +1
Neural text decoding is important for generating high-quality texts using language models. To generate high-quality text, popular decoding algorithms like top-k, top-p (nucleus), a…
Functional Epsilon Entropy
Sourya Basu, Daewon Seo, Lav R. Varshney
We consider the problem of coding for computing with maximal distortion, where the sender communicates with a receiver, which has its own private data and wants to compute a functi…
Coding for Computing Arbitrary Functions Unknown to the Encoder
Sourya Basu, Lav R. Varshney
In this paper we consider point-to-point and distributed source coding problems where the receiver is only interested in a function of the data sent by the source encoder(s), while…
Universal and Succinct Source Coding of Deep Neural Networks
Sourya Basu, Lav R. Varshney
Deep neural networks have shown incredible performance for inference tasks in a variety of domains. Unfortunately, most current deep networks are enormous cloud-based structures th…