147 citations · 391 across the 75 of their papers we have counts for
16 papers · 1 filter
Boosting the Cross-Architecture Generalization of Dataset Distillation through an Empirical Study
Lirui Zhao, Yuxin Zhang, Fei Chao +1
The poor cross-architecture generalization of dataset distillation greatly weakens its practical significance. This paper attempts to mitigate this issue through an empirical study…
I&S-ViT: An Inclusive & Stable Method for Pushing the Limit of Post-Training ViTs Quantization
Yunshan Zhong, Jiawei Hu, Mingbao lin +2
Albeit the scalable performance of vision transformers (ViTs), the dense computational costs (training & inference) undermine their position in industrial applications. Post-traini…
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs
Yuxin Zhang, Lirui Zhao, Mingbao Lin +6
The ever-increasing large language models (LLMs), though opening a potential path for the upcoming artificial general intelligence, sadly drops a daunting obstacle on the way towar…
MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversation
Junru Lu, Siyu An, Mingbao Lin +5
We propose MemoChat, a pipeline for refining instructions that enables large language models (LLMs) to effectively employ self-composed memos for maintaining consistent long-range…
Representation Disparity-aware Distillation for 3D Object Detection
Yanjing Li, Sheng Xu, Mingbao Lin +3
In this paper, we focus on developing knowledge distillation (KD) for compact 3D detectors. We observe that off-the-shelf KD methods manifest their efficacy only when the teacher m…
Unified and Dynamic Graph for Temporal Character Grouping in Long Videos
Xiujun Shu, Wei Wen, Liangsheng Xu +6
Video temporal character grouping locates appearing moments of major characters within a video according to their identities. To this end, recent works have evolved from unsupervis…
Spatial Re-parameterization for N:M Sparsity
Yuxin Zhang, Mingbao Lin, Mingliang Xu +2
This paper presents a Spatial Re-parameterization (SpRe) method for the N:M sparsity. SpRe stems from an observation regarding the restricted variety in spatial sparsity of convolu…
DiffRate : Differentiable Compression Rate for Efficient Vision Transformers
Mengzhao Chen, Wenqi Shao, Peng Xu +6
Token compression aims to speed up large-scale vision transformers (e.g. ViTs) by pruning (dropping) or merging tokens. It is an important but challenging task. Although recent adv…
Bi-ViT: Pushing the Limit of Vision Transformer Quantization
Yanjing Li, Sheng Xu, Mingbao Lin +4
Vision transformers (ViTs) quantization offers a promising prospect to facilitate deploying large pre-trained networks on resource-limited devices. Fully-binarized ViTs (Bi-ViT) th…
Distribution-Flexible Subset Quantization for Post-Quantizing Super-Resolution Networks
Yunshan Zhong, Mingbao Lin, Jingjing Xie +3
This paper introduces Distribution-Flexible Subset Quantization (DFSQ), a post-training quantization method for super-resolution networks. Our motivation for developing DFSQ is bas…
MBQuant: A Novel Multi-Branch Topology Method for Arbitrary Bit-width Network Quantization
Yunshan Zhong, Yuyao Zhou, Fei Chao +1
Arbitrary bit-width network quantization has received significant attention due to its high adaptability to various bit-width requirements during runtime. However, in this paper, w…
Q-DETR: An Efficient Low-Bit Quantized Detection Transformer
Sheng Xu, Yanjing Li, Mingbao Lin +4
The recent detection transformer (DETR) has advanced object detection, but its application on resource-constrained devices requires massive computation and memory resources. Quanti…
Bi-directional Masks for Efficient N:M Sparse Training
Yuxin Zhang, Yiting Luo, Mingbao Lin +4
We focus on addressing the dense backward propagation issue for training efficiency of N:M fine-grained sparsity that preserves at most N out of M consecutive weights and achieves…
Resilient Binary Neural Network
Sheng Xu, Yanjing Li, Teli Ma +5
Binary neural networks (BNNs) have received ever-increasing popularity for their great capability of reducing storage burden as well as quickening inference time. However, there is…
Real-Time Image Demoireing on Mobile Devices
Yuxin Zhang, Mingbao Lin, Xunchao Li +7
Moire patterns appear frequently when taking photos of digital screens, drastically degrading the image quality. Despite the advance of CNNs in image demoireing, existing networks…
Low-Rank Winograd Transformation for 3D Convolutional Neural Networks
Ziran Qin, Mingbao Lin, Weiyao Lin
This paper focuses on Winograd transformation in 3D convolutional neural networks (CNNs) that are more over-parameterized compared with the 2D version. The over-increasing Winograd…