From the 1 of 8 linked papers with an AI index.
8 papers
Let it Cook: Learning to Wait in Sequential Decision Making
Christopher Watson, Arjun Krishna, Dinesh Jayaraman +1
In sequential decision making, an agent typically observes its environment and acts at every timestep. However, such active participation may not always be necessary; tasks such as…
Bridge Evidence: Static Retrieval Utility Does Not Predict Causal Utility in Multi-Step Agentic Search
Debayan Mukhopadhyay, Utshab Kumar Ghosh, Shubham Chatterjee
The paper shows that static measures of document usefulness do not predict how useful those documents are for multi-step search agents, introducing a counterfactual evaluation meth…
Entity Labels Are Not Entity Signals: A Framework for Observable Relevance in Document Re-Ranking
Utshab Kumar Ghosh, Shubham Chatterjee
Entity-aware document retrieval uses query-associated entities as ranking signals, assuming that semantically relevant entities are also useful retrieval signals. We show this assu…
Reproduction Beyond Benchmarks: ConstBERT and ColBERT-v2 Across Backends and Query Distributions
Utshab Kumar Ghosh, Ashish David, Shubham Chatterjee
Reproducibility must validate architectural robustness, not just numerical accuracy. We evaluate ColBERT-v2 and ConstBERT across five dimensions, finding that while ConstBERT repro…
Entities as Retrieval Signals: A Systematic Study of Coverage, Supervision, and Evaluation in Entity-Oriented Ranking
Shubham Chatterjee
Entity-oriented retrieval assumes that relevant documents exhibit query-relevant entities, yet evaluations report conflicting results. We show this inconsistency stems not from mod…
Interplay: Training Independent Simulators for Reference-Free Conversational Recommendation
Jerome Ramos, Feng Xia, Xi Wang +4
Training conversational recommender systems (CRS) requires extensive dialogue data, which is challenging to collect at scale. To address this, researchers have used simulated user-…