4 papers
How Chain-of-Thought Works? Tracing Information Flow from Decoding, Projection, and Activation
Hao Yang, Qinghua Zhao, Lei Li +2
Chain-of-Thought (CoT) prompting significantly enhances model reasoning, yet its internal mechanisms remain poorly understood. We analyze CoT's operational principles by reversely…
Beyond Frequency: The Role of Redundancy in Large Language Model Memorization
Jie Zhang, Qinghua Zhao, Chi-ho Lin +2
Memorization in large language models poses critical risks for privacy and fairness as these systems scale to billions of parameters. While previous studies established correlation…
Reassessing the Role of Chain-of-Thought in Sentiment Analysis: Insights and Limitations
Kaiyuan Zheng, Qinghua Zhao, Lei Li
The relationship between language and thought remains an unresolved philosophical issue. Existing viewpoints can be broadly categorized into two schools: one asserting their indepe…
Word Order's Impacts: Insights from Reordering and Generation Analysis
Qinghua Zhao, Jiaang Li, Lei Li +2
Existing works have studied the impacts of the order of words within natural text. They usually analyze it by destroying the original order of words to create a scrambled sequence,…