5 papers · 1 filter
COEC: Calibrated Orthogonal-Equivalence Compensation for Structured Pruning of Large Language Models
Peiqi Yu, Nam Ling, Wei Wang +1
Structured pruning reduces the size and inference cost of large language models (LLMs) by removing weight columns, but the resulting output error can degrade accuracy. Existing tra…
CORAM: Coherent Orthogonal Rotation for Model Merging
Xinyi Sui, Ziran Liu, Nam Ling +2
Merging finetuned models combines specialized capabilities without joint training or access to the original data. Most methods operate by linear arithmetic in Euclidean weight spac…
Geometric and Spectral Alignment for Deep Neural Network II
Ziran Liu, Wei Wang, Jinhao Wang +5
This paper develops the angular and static-channel component of Geometric and Spectral Alignment for residual Jacobian chains. Starting from Cartan-coordinate rigidity and fitted e…
Geometric and Spectral Alignment for Deep Neural Network I
Ziran Liu, Wei Wang, Jinhao Wang +5
Deep residual architectures are modeled as products of near-identity Jacobians. This paper proves deterministic quotient-geometric estimates for singular spectra of Frobenius-norma…
SCONE: A Practical, Constraint-Aware Plug-in for Latent Encoding in Learned DNA Storage
Cihan Ruan, Lebin Zhou, Rongduo Han +6
DNA storage has matured from concept to practical stage, yet its integration with neural compression pipelines remains inefficient. Early DNA encoders applied redundancy-heavy cons…