4 papers
Diffusion Alignment Beyond KL: Variance Minimisation as Effective Policy Optimiser
Zijing Ou, Jacob Si, Junyi Zhu +4
Diffusion alignment adapts pretrained diffusion models to sample from reward-tilted distributions along the denoising trajectory. This process naturally admits a Sequential Monte C…
TabRAG: Improving Tabular Document Question Answering for Retrieval Augmented Generation via Structured Representations
Jacob Si, Mike Qu, Michelle Lee +2
Incorporating external knowledge bases in traditional retrieval-augmented generation (RAG) relies on parsing the document, followed by querying a language model with the parsed inf…
TabRep: Training Tabular Diffusion Models with a Simple and Effective Continuous Representation
Jacob Si, Zijing Ou, Mike Qu +2
Diffusion models have been the predominant generative model for tabular data generation. However, they face the conundrum of modeling under a separate versus a unified data represe…
Variational Uncertainty Decomposition for In-Context Learning
I. Shavindra Jayasekera, Jacob Si, Filippo Valdettaro +3
As large language models (LLMs) gain popularity in conducting prediction tasks in-context, understanding the sources of uncertainty in in-context learning becomes essential to ensu…