4 papers
Multiple Importance Sampling for Guided Speculative Inference
Joseph Rowan, Ashish J. Khisti
We study an extension of the Guided Speculative Inference (GSI) algorithm for test-time-scaling of large language models (LLMs) to a novel setting where an ensemble of smaller LLMs…
Scalable Discrete-to-Continuous Channel Simulation for Compression and Privacy
Joseph Rowan, Buu Phan, Ashish J. Khisti
Channel simulation has recently emerged as a useful component in machine learning systems where samples from a prescribed probability distribution are to be compressed. Yet, genera…
One-Shot Broadcast Joint Source-Channel Coding with Codebook Diversity
Joseph Rowan, Buu Phan, Ashish Khisti
We study a one-shot joint source-channel coding setting where the source is encoded once and broadcast to decoders through independent channels. Success is predicated on at lea…
List-Level Distribution Coupling with Applications to Speculative Decoding and Lossy Compression
Joseph Rowan, Buu Phan, Ashish Khisti
We study a relaxation of the problem of coupling probability distributions -- a list of samples is generated from one distribution and an accept is declared if any one of these sam…