12 papers
Ordering Matters: Rank-Aware Selective Fusion for Blended Emotion Recognition
Junghyun Lee, Hyunseo Kim, Hanna Jang +1
Blended emotion recognition is challenging because emotions are often expressed as mixtures of subtle and overlapping multimodal cues rather than a single dominant signal. We propo…
Instance-Optimal Estimation with Multiple LLM Judges on a Budget
Junghyun Lee, Sanghwa Kim, Yassir Jedra +2
Evaluating large language models increasingly relies on LLM-as-a-judge protocols, but such evaluations remain costly: different judges have different prices and reliabilities, and…
Random Is Hard to Beat: Active Selection in online DPO with Modern LLMs
Giyeong Oh, Junghyun Lee, Jaehyun Park +3
Modern LLMs inherit strong priors from web-scale pretraining, which can limit the headroom of post-training data-selection strategies. While Active Preference Learning (APL) seeks…
Provably Efficient Regularized Online RLHF with Generalized Bilinear Preferences
Junghyun Lee, Minju Hong, Kwang-Sung Jun +2
We consider the problem of regularized best-response max-regret minimization in online RLHF under general preferences and bandit feedback. While various regularizers are utilized t…
A Jointly Efficient and Optimal Algorithm for Heteroskedastic Generalized Linear Bandits with Adversarial Corruptions
Sanghwa Kim, Junghyun Lee, Se-Young Yun
We consider the problem of heteroskedastic generalized linear bandits (GLBs) with adversarial corruptions, which subsumes heteroskedastic linear bandits and logistic/Poisson bandit…
Learning to Reason in LLMs by Expectation Maximization
Junghyun Lee, Branislav Kveton, Anup Rao +4
Large language models (LLMs) solve reasoning problems by first generating a rationale and then answering. We formalize reasoning as a latent variable model and derive a reward-base…