4 papers
Extracting Algorithms in Pre-trained LLMs: A Case on Hidden Markov Models
Yijia Dai, Zhaolin Gao, Yahya Sattar +2
Large language models (LLMs) display a striking ability to predict next observations from Hidden Markov Models (HMMs) via in-context learning (ICL), but the algorithm underlying th…
Pre-trained Large Language Models Learn Hidden Markov Models In-context
Yijia Dai, Zhaolin Gao, Yahya Sattar +2
Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challen…
Sample Efficient Preference Alignment in LLMs via Active Exploration
Viraj Mehta, Syrine Belakaria, Vikramjeet Das +7
Preference-based feedback is important for many applications in machine learning where evaluation of a reward function is not feasible. Notable recent examples arise in preference…
End-to-end Training for Recommendation with Language-based User Profiles
Zhaolin Gao, Joyce Zhou, Yijia Dai +1
There is a growing interest in natural language-based user profiles for recommender systems, which aims to enhance transparency and scrutability compared with embedding-based metho…