activity
20222026
most citedWhat can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks

93 citations · 178 across the 14 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.AI2024

Knowledge Graph Enhanced Language Agents for Recommendation

Taicheng Guo, Chaochun Liu, Hai Wang +5

Language agents have recently been used to simulate human behavior and user-item interactions for recommendation systems. However, current language agent simulations do not underst…

cs.CL2024★ 1 cited

ScholarChemQA: Unveiling the Power of Language Models in Chemical Research Question Answering

Xiuying Chen, Tairan Wang, Taicheng Guo +7

Question Answering (QA) effectively evaluates language models' reasoning and knowledge depth. While QA datasets are plentiful in areas like general domain and biomedicine, academic…

cs.AI2024

SceMQA: A Scientific College Entrance Level Multimodal Question Answering Benchmark

Zhenwen Liang, Kehan Guo, Gang Liu +7

The paper introduces SceMQA, a novel benchmark for scientific multimodal question answering at the college entrance level. It addresses a critical educational phase often overlooke…

cs.AI2024★ 11 cited

Data Interpreter: An LLM Agent For Data Science

Sirui Hong, Yizhang Lin, Bang Liu +24

Large Language Model (LLM)-based agents have shown effectiveness across many applications. However, their use in data science scenarios requiring solving long-term interconnected t…

cs.CL2024

Rethinking Scientific Summarization Evaluation: Grounding Explainable Metrics on Facet-aware Benchmark

Xiuying Chen, Tairan Wang, Qingqing Zhu +5

The summarization capabilities of pretrained and large language models (LLMs) have been widely validated in general areas, but their use in scientific corpus, which involves comple…

cs.LG2024★ 3 cited

Defending Jailbreak Prompts via In-Context Adversarial Game

Yujun Zhou, Yufei Han, Haomin Zhuang +4

Large Language Models (LLMs) demonstrate remarkable capabilities across diverse applications. However, concerns regarding their security, particularly the vulnerability to jailbrea…

cs.CL2024★ 68 cited

Large Language Model based Multi-Agents: A Survey of Progress and Challenges

Taicheng Guo, Xiuying Chen, Yaqi Wang +5

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as a…