4 papers
SLMQuant:Benchmarking Small Language Model Quantization for Practical Deployment
Jiacheng Wang, Yejun Zeng, Jinyang Guo +3
Despite the growing interest in Small Language Models (SLMs) as resource-efficient alternatives to Large Language Models (LLMs), their deployment on edge devices remains challengin…
Exploring Semantic-constrained Adversarial Example with Instruction Uncertainty Reduction
Jin Hu, Jiakai Wang, Linna Jing +6
Recently, semantically constrained adversarial examples (SemanticAE), which are directly generated from natural language instructions, have become a promising avenue for future res…
BiVM: Accurate Binarized Neural Network for Efficient Video Matting
Haotong Qin, Xianglong Liu, Xudong Ma +4
Deep neural networks for real-time video matting suffer significant computational limitations on edge devices, hindering their adoption in widespread applications such as online co…
PTSBench: A Comprehensive Post-Training Sparsity Benchmark Towards Algorithms and Models
Zining Wnag, Jinyang Guo, Ruihao Gong +5
With the increased attention to model efficiency, post-training sparsity (PTS) has become more and more prevalent because of its effectiveness and efficiency. However, there remain…