1 citations · 1 across the 7 of their papers we have counts for
7 papers
The Context Gathering Decision Process: A POMDP Framework for Agentic Search
Chinmaya Kausik, Adith Swaminathan, Nathan Kallus
Large Language Model (LLM) agents are deployed in complex environments -- such as massive codebases, enterprise databases, and conversational histories -- where the relevant state…
Leveraging Offline Data in Linear Latent Contextual Bandits
Chinmaya Kausik, Kevin Tan, Ambuj Tewari
Leveraging offline data is an attractive way to accelerate online sequential decision-making. However, it is crucial to account for latent states in users or environments in the of…
A Theoretical Framework for Partially Observed Reward-States in RLHF
Chinmaya Kausik, Mirco Mutti, Aldo Pacchiano +1
The growing deployment of reinforcement learning from human feedback (RLHF) calls for a deeper theoretical investigation of its underlying models. The prevalent models of RLHF do n…
Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers
Chinmaya Kausik, Kashvi Srivastava, Rishi Sonthalia
Despite the importance of denoising in modern machine learning and ample empirical work on supervised denoising, its theoretical understanding is still relatively scarce. One conce…
Offline Policy Evaluation and Optimization under Confounding
Chinmaya Kausik, Yangyi Lu, Kevin Tan +3
Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offl…
Learning Mixtures of Markov Chains and MDPs
Chinmaya Kausik, Kevin Tan, Ambuj Tewari
We present an algorithm for learning mixtures of Markov chains and Markov decision processes (MDPs) from short unlabeled trajectories. Specifically, our method handles mixtures of…
An algorithm to calculate generalized Seifert matrices
Stefan Friedl, Chinmaya Kausik, José Pedro Quintanilha
We develop an algorithm for computing generalized Seifert matrices for colored links given as closures of colored braids. The algorithm has been implemented by the second author as…