565 citations · 2.3k across the 68 of their papers we have counts for
9 papers · 1 filter
QualEval: Qualitative Evaluation for Model Improvement
Vishvak Murahari, Ameet Deshpande, Peter Clark +4
Quantitative evaluation metrics have traditionally been pivotal in gauging the advancements of artificial intelligence systems, including large language models (LLMs). However, the…
A Logic for Expressing Log-Precision Transformers
William Merrill, Ashish Sabharwal
One way to interpret the reasoning power of transformer-based language models is to describe the types of logical rules they can resolve over some input text. Recently, Chiang et a…
Belief Propagation Neural Networks
Jonathan Kuck, Shuvam Chakraborty, Hao Tang +4
Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still l…
Adversarial Filters of Dataset Biases
Ronan Le Bras, Swabha Swayamdipta, Chandra Bhagavatula +4
Large neural models have demonstrated human-level performance on language and vision benchmarks, while their performance degrades considerably on adversarial or out-of-distribution…
Approximating the Permanent by Sampling from Adaptive Partitions
Jonathan Kuck, Tri Dao, Hamid Rezatofighi +2
Computing the permanent of a non-negative matrix is a core problem with practical applications ranging from target tracking to statistical thermodynamics. However, this problem is…
Towards Efficient Discrete Integration via Adaptive Quantile Queries
Fan Ding, Hanjing Wang, Ashish Sabharwal +1
Discrete integration in a high dimensional space of n variables poses fundamental challenges. The WISH algorithm reduces the intractable discrete integration problem into n optimiz…