activity
20202024
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 654 across the 13 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.CL2023

Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneck

Josh Magnus Ludan, Qing Lyu, Yue Yang +3

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose…

cs.CL2023

Explanation-based Finetuning Makes Models More Robust to Spurious Cues

Josh Magnus Ludan, Yixuan Meng, Tai Nguyen +4

Large Language Models (LLMs) are so powerful that they sometimes learn correlations between labels and features that are irrelevant to the task, leading to poor generalization on o…

cs.CL2023

Representation Of Lexical Stylistic Features In Language Models' Embedding Space

Qing Lyu, Marianna Apidianaki, Chris Callison-Burch

The representation space of pretrained Language Models (LMs) encodes rich information about words and their relationships (e.g., similarity, hypernymy, polysemy) as well as abstrac…

cs.CL2023★ 7 cited

M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language Models

Chuang Liu, Renren Jin, Yuqi Ren +10

Large language models have recently made tremendous progress in a variety of aspects, e.g., cross-task generalization, instruction following. Comprehensively evaluating the capabil…

cs.CL2023★ 23 cited

Faithful Chain-of-Thought Reasoning

Qing Lyu, Shreya Havaldar, Adam Stein +5

While Chain-of-Thought (CoT) prompting boosts Language Models' (LM) performance on a gamut of complex reasoning tasks, the generated reasoning chain does not necessarily reflect ho…