7 papers
Beyond Forgetting: Machine Unlearning Elicits Controllable Side Behaviors and Capabilities
Tien Dang, The-Hai Nguyen, Dinh Mai Phuong +5
We consider Representation Misdirection (RM), a class of large language model (LLM) unlearning methods that achieve forgetting by redirecting the forget-representations, that is, l…
RegMean++: Enhancing Effectiveness and Generalization of Regression Mean for Model Merging
The-Hai Nguyen, Dang Huu-Tien, Takeshi Suzuki +1
Regression Mean (RegMean), an approach that formulates model merging as a linear regression problem, aims to find the optimal weights for each linear layer in the merged model by m…
Improving LLM Unlearning Robustness via Random Perturbations
Dang Huu-Tien, Hoang Thanh-Tung, Anh Bui +3
Here, we show that current LLM unlearning methods inherently reduce models' robustness, causing them to misbehave even when a single non-adversarial forget-token is present in the…
Improving Chain-of-Thought for Logical Reasoning via Attention-Aware Intervention
Nguyen Minh Phuong, Dang Huu Tien, Naoya Inoue
Modern logical reasoning with LLMs primarily relies on employing complex interactive frameworks that decompose the reasoning process into subtasks solved through carefully designed…
Detecting and Rectifying Noisy Labels: A Similarity-based Approach
Dang Huu-Tien, Minh-Phuong Nguyen, Naoya Inoue
Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there…
Non-Interactive Symbolic-Aided Chain-of-Thought for Logical Reasoning
Phuong Minh Nguyen, Tien Huu Dang, Naoya Inoue
This work introduces Symbolic-Aided Chain-of-Thought (CoT), an improved approach to standard CoT, for logical reasoning in large language models (LLMs). The key idea is to integrat…