6 citations · 6 across the 14 of their papers we have counts for
4 papers · 1 filter
Frontier AI performance across the business disciplines: a case-grounded benchmark of knowledge work and analytical reasoning
Ajay Patel, Kartik Hosanagar, Ramayya Krishnan +2
Large language models (LLMs) are improving rapidly as reflected in benchmark scores, yet these AI benchmarks largely test capabilities such as factual recall, narrow question answe…
LLMs Know the Constraint But Do Not Use It: Activation Bottlenecks in Pragmatic Constraint Reasoning
Yubo Li, Ramayya Krishnan, Rema Padman
When a salient surface cue competes with an implicit feasibility constraint, LLMs often fail -- but aggregate accuracy conflates genuine constraint inference with conservative defa…
Same Question, Different Source, Different Answer: Auditing Source-Dependence in Medical Multi-Source RAG
Yubo Li, Rema Padman, Ramayya Krishnan
A retrieval-augmented generation (RAG) system deployed over a multi-author institutional corpus can give a different answer to the same question depending on which source it retrie…
The Model Says Walk: Measuring whether LLMs Condition on Hidden Constraints
Yubo Li, Lu Zhang, Tianchong Jiang +2
Asked whether to walk or drive to a car wash 50 m away, most language models say walk, forgetting that the car has to be there. Such failures are usually measured by accuracy on qu…