167 citations · 186 across the 15 of their papers we have counts for
17 papers
AutoSciBench: Autonomous Benchmark Generation for Evaluating Scientific Agents
Dongki Kim, Namkyeong Lee, Surag Nair +7
As agents rapidly evolve, existing benchmarks can become saturated, limiting their ability to distinguish capabilities and reveal remaining failure modes. Particularly in scientifi…
AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
Edward De Brouwer, Carl Edwards, Alexander Wu +9
Recent advances in machine learning and large-scale biological data collections have revived the prospect of building a virtual cell, a computational model of cellular behavior tha…
DC-W2S: Dual-Consensus Weak-to-Strong Training for Reliable Process Reward Modeling in Biological Reasoning
Chi-Min Chan, Ehsan Hajiramezanali, Xiner Li +6
In scientific reasoning tasks, the veracity of the reasoning process is as critical as the final outcome. While Process Reward Models (PRMs) offer a solution to the coarse-grained…
Learning Predictive Checklists with Probabilistic Logic Programming
Yukti Makhija, Edward De Brouwer, Rahul G. Krishnan
Checklists have been widely recognized as effective tools for completing complex tasks in a systematic manner. Although originally intended for use in procedural tasks, their inter…
Convergence of Manifold Filter-Combine Networks
David R. Johnson, Joyce Chew, Siddharth Viswanath +4
In order to better understand manifold neural networks (MNNs), we introduce Manifold Filter-Combine Networks (MFCNs). The filter-combine framework parallels the popular aggregate-c…
Benchmarking Observational Studies with Experimental Data under Right-Censoring
Ilker Demirel, Edward De Brouwer, Zeshan Hussain +3
Drawing causal inferences from observational studies (OS) requires unverifiable validity assumptions; however, one can falsify those assumptions by benchmarking the OS with experim…