4 papers · 1 filter
SafeAnchor: Preventing Cumulative Safety Erosion in Continual Domain Adaptation of Large Language Models
Dongxin Guo, Jikun Wu, Siu Ming Yiu
Safety alignment in large language models is remarkably shallow: it is concentrated in the first few output tokens and reversible by fine-tuning on as few as 100 adversarial exampl…
Closing the Theory-Practice Gap in Spiking Transformers via Effective Dimension
Dongxin Guo, Jikun Wu, Siu Ming Yiu
Spiking transformers achieve competitive accuracy with conventional transformers while offering - energy efficiency on neuromorphic hardware, yet no theoretical frame…
When Do Early-Exit Networks Generalize? A PAC-Bayesian Theory of Adaptive Depth
Dongxin Guo, Jikun Wu, Siu Ming Yiu
Early-exit neural networks enable adaptive computation by allowing confident predictions to exit at intermediate layers, achieving 2-8 inference speedup. Despite widespread…
Capacity-Controlled Global Attention for Graph Transformers
Yang Liu, Dongxin Guo, Tom Zheng +3
Global self-attention drives modern graph transformers, yet the softmax at its core imposes a structural constraint rarely examined directly: every attention row is non-negative an…