25 citations · 50 across the 21 of their papers we have counts for
4 papers · 1 filter
Elastic-dLLM: Position Preserving Context Compression and Augmentation of Diffusion LLMs
Junyi Wu, Tianchen Zhao, Shaoqiu Zhang +3
Unlike autoregressive models, which generate one token at a time, dLLMs denoise a chunk of [MASK] tokens jointly and sample one or more tokens per step; despite enabling parallel d…
Dynamic Ensemble of Low-fidelity Experts: Mitigating NAS "Cold-Start"
Junbo Zhao, Xuefei Ning, Enshu Liu +7
Predictor-based Neural Architecture Search (NAS) employs an architecture performance predictor to improve the sample efficiency. However, predictor-based NAS suffers from the sever…
Exploring the Potential of Low-bit Training of Convolutional Neural Networks
Kai Zhong, Xuefei Ning, Guohao Dai +5
In this work, we propose a low-bit training framework for convolutional neural networks, which is built around a novel multi-level scaling (MLS) tensor format. Our framework focuse…
A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS
Xuefei Ning, Yin Zheng, Tianchen Zhao +2
This work proposes a novel Graph-based neural ArchiTecture Encoding Scheme, a.k.a. GATES, to improve the predictor-based neural architecture search. Specifically, different from ex…