4 papers
Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering
Li Zheng, Xin Zhang, Shuyi He +5
Accurate comprehension and controllable generation of emotion and rhetoric are pivotal for enhancing the reasoning capabilities of large language models (LLMs). Existing studies mo…
The Backpropagation of the Wave Network
Xin Zhang, Victor S. Sheng
This paper provides an in-depth analysis of Wave Network, a novel token representation method derived from the Wave Network, designed to capture both global and local semantics of…
Wave Network: An Ultra-Small Language Model
Xin Zhang, Victor S. Sheng
We propose an innovative token representation and update method in a new ultra-small language model: the Wave network. Specifically, we use a complex vector to represent each token…
Neuro-Symbolic AI: Explainability, Challenges, and Future Trends
Xin Zhang, Victor S. Sheng
Explainability is an essential reason limiting the application of neural networks in many vital fields. Although neuro-symbolic AI hopes to enhance the overall explainability by le…