19 citations · 56 across the 11 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2024★ 2 cited
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models
Cheng Lin, Lujun Li, Dezhi Li +3
In this paper, we introduce Nested Low-Rank Adaptation (NoRA), a novel approach to parameter-efficient fine-tuning that extends the capabilities of Low-Rank Adaptation (LoRA) techn…
cs.LG2024★ 4 cited
Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models
Peijie Dong, Lujun Li, Zhenheng Tang +4
Despite the remarkable capabilities, Large Language Models (LLMs) face deployment challenges due to their extensive size. Pruning methods drop a subset of weights to accelerate, bu…
cs.LG2023★ 9 cited
GP-NAS-ensemble: a model for NAS Performance Prediction
Kunlong Chen, Liu Yang, Yitian Chen +3
It is of great significance to estimate the performance of a given model architecture without training in the application of Neural Architecture Search (NAS) as it may take a lot o…