4 papers
Exploring Diverse Generation Paths via Inference-time Stiefel Activation Steering
Dongxuan Zhu, Ly Tran Ho Khanh, Andy Yat-Ming Cheung +2
Language models often default to a narrow set of high-probability outputs, leaving their generation paths homogeneous and prone to mode collapse. Sampling-based strategies inject r…
A Geometric Unification of Distributionally Robust Covariance Estimators: Shrinking the Spectrum by Inflating the Ambiguity Set
Man-Chung Yue, Yves Rychener, Daniel Kuhn +1
The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage tar…
Test-time Diverse Reasoning by Riemannian Activation Steering
Ly Tran Ho Khanh, Dongxuan Zhu, Man-Chung Yue +1
Best-of- reasoning improves the accuracy of language models in solving complex tasks by sampling multiple candidate solutions and then selecting the best one based on some crite…
Coverage-Validity-Aware Algorithmic Recourse
Ngoc Bui, Duy Nguyen, Man-Chung Yue +1
Algorithmic recourse emerges as a prominent technique to promote the explainability, transparency, and ethics of machine learning models. Existing algorithmic recourse approaches o…