1 citations · 1 across the 4 of their papers we have counts for
3 papers · 1 filter
GPrune-LLM: Generalization-Aware Structured Pruning for Large Language Models
Xiaoyun Liu, Divya Saxena, Jiannong Cao +3
Structured pruning is widely applied to compress large language models (LLMs), but its performance depends heavily on how neuron importance is estimated. Most existing methods rely…
Overcoming Growth-Induced Forgetting in Task-Agnostic Continual Learning
Yuqing Zhao, Jiannong Cao, Divya Saxena +4
In continual learning (CL), model growth enhances adaptability to new data. However, when model growth is applied improperly, especially in task-agnostic CL, where the entire grown…
MGAS: Multi-Granularity Architecture Search for Trade-Off Between Model Effectiveness and Efficiency
Xiaoyun Liu, Divya Saxena, Jiannong Cao +2
Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) refram…