activity
20232026
most citedCausal Evaluation of Language Models

3 citations · 8 across the 22 of their papers we have counts for

collaborators
Showing 2024Show all

8 papers · 1 filter

cs.CL2024

Beyond Surface Structure: A Causal Assessment of LLMs' Comprehension Ability

Yujin Han, Lei Xu, Sirui Chen +2

Large language models (LLMs) have shown remarkable capability in natural language tasks, yet debate persists on whether they truly comprehend deep structure (i.e., core semantics)…

cs.AI2024

ADAM: An Embodied Causal Agent in Open-World Environments

Shu Yu, Chaochao Lu

In open-world environments like Minecraft, existing agents face challenges in continuously learning structured knowledge, particularly causality. These challenges stem from the opa…

cs.CL2024

From Imitation to Introspection: Probing Self-Consciousness in Language Models

Sirui Chen, Shu Yu, Shengjie Zhao +1

Self-consciousness, the introspection of one's existence and thoughts, represents a high-level cognitive process. As language models advance at an unprecedented pace, a critical qu…

cs.CV2024

Interpreting Low-level Vision Models with Causal Effect Maps

Jinfan Hu, Jinjin Gu, Shiyao Yu +5

Deep neural networks have significantly improved the performance of low-level vision tasks but also increased the difficulty of interpretability. A deep understanding of deep model…

cs.CV2024

CELLO: Causal Evaluation of Large Vision-Language Models

Meiqi Chen, Bo Peng, Yan Zhang +1

Causal reasoning is fundamental to human intelligence and crucial for effective decision-making in real-world environments. Despite recent advancements in large vision-language mod…

cs.CL2024★ 1 cited

CLEAR: Can Language Models Really Understand Causal Graphs?

Sirui Chen, Mengying Xu, Kun Wang +4

Causal reasoning is a cornerstone of how humans interpret the world. To model and reason about causality, causal graphs offer a concise yet effective solution. Given the impressive…

cs.CL2024★ 3 cited

Causal Evaluation of Language Models

Sirui Chen, Bo Peng, Meiqi Chen +7

Causal reasoning is viewed as crucial for achieving human-level machine intelligence. Recent advances in language models have expanded the horizons of artificial intelligence acros…

cs.CV2024★ 3 cited

From GPT-4 to Gemini and Beyond: Assessing the Landscape of MLLMs on Generalizability, Trustworthiness and Causality through Four Modalities

Chaochao Lu, Chen Qian, Guodong Zheng +33

Multi-modal Large Language Models (MLLMs) have shown impressive abilities in generating reasonable responses with respect to multi-modal contents. However, there is still a wide ga…