From the 1 of 15 linked papers with an AI index.
6 papers · 1 filter
Secure LLM Fine-Tuning via Safety-Aware Probing
Chengcan Wu, Zhixin Zhang, Zeming Wei +3
Large language models (LLMs) have achieved remarkable success across many applications, but their ability to generate harmful content raises serious safety concerns. Although safet…
Absorber LLM: Harnessing Causal Synchronization for Test-Time Training
Zhixin Zhang, Shabo Zhang, Chengcan Wu +2
Transformers suffer from a high computational cost that grows with sequence length for self-attention, making inference in long streams prohibited by memory consumption. Constant-m…
Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
Zhixin Zhang, Zeming Wei, Meng Sun
Catastrophic forgetting remains a critical challenge in continual learning for large language models (LLMs), where models struggle to retain performance on historical tasks when fi…
Reliable Unlearning Harmful Information in LLMs with Metamorphosis Representation Projection
Chengcan Wu, Zeming Wei, Huanran Chen +2
While Large Language Models (LLMs) have demonstrated impressive performance in various domains and tasks, concerns about their safety are becoming increasingly severe. In particula…
Adversarial Representation Engineering: A General Model Editing Framework for Large Language Models
Yihao Zhang, Zeming Wei, Jun Sun +1
Since the rapid development of Large Language Models (LLMs) has achieved remarkable success, understanding and rectifying their internal complex mechanisms has become an urgent iss…
Automata Extraction from Transformers
Yihao Zhang, Zeming Wei, Meng Sun
In modern machine (ML) learning systems, Transformer-based architectures have achieved milestone success across a broad spectrum of tasks, yet understanding their operational mecha…