activity
20242026
most citedA Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms

4 citations · 5 across the 15 of their papers we have counts for

collaborators

18 papers

cs.CV2026

TinyML Enhances CubeSat Mission Capabilities

Luigi Capogrosso, Michele Magno

Earth observation (EO) missions traditionally rely on transmitting raw or minimally processed imagery from satellites to ground stations for computationally intensive analysis. Thi…

cs.CV2025

QuantSparse: Comprehensively Compressing Video Diffusion Transformer with Model Quantization and Attention Sparsification

Weilun Feng, Chuanguang Yang, Haotong Qin +8

Diffusion transformers exhibit remarkable video generation capability, yet their prohibitive computational and memory costs hinder practical deployment. Model quantization and atte…

cs.CV2025

Quantized Visual Geometry Grounded Transformer

Weilun Feng, Haotong Qin, Mingqiang Wu +8

Learning-based 3D reconstruction models, represented by Visual Geometry Grounded Transformers (VGGTs), have made remarkable progress with the use of large-scale transformers. Their…

cs.CV2025

SQ-VDiT: Accurate Quantized Video Diffusion Transformer with Salient Data and Sparse Token Distillation

Weilun Feng, Haotong Qin, Chuanguang Yang +7

Diffusion transformers have emerged as the mainstream paradigm for video generation models. However, the use of up to billions of parameters incurs significant computational costs.…

cs.CV2025

BiVM: Accurate Binarized Neural Network for Efficient Video Matting

Haotong Qin, Xianglong Liu, Xudong Ma +4

Deep neural networks for real-time video matting suffer significant computational limitations on edge devices, hindering their adoption in widespread applications such as online co…

cs.CV2025

MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillation

Weilun Feng, Chuanguang Yang, Haotong Qin +10

Diffusion models have demonstrated remarkable performance on vision generation tasks. However, the high computational complexity hinders its wide application on edge devices. Quant…

cs.LG2025

First-Order Error Matters: Accurate Compensation for Quantized Large Language Models

Xingyu Zheng, Haotong Qin, Yuye Li +5

Post-training quantization (PTQ) offers an efficient approach to compressing large language models (LLMs), significantly reducing memory access and computational costs. Existing co…

cs.CV2025

Post-Training Quantization for Video Matting

Tianrui Zhu, Houyuan Chen, Ruihao Gong +3

Video matting is crucial for applications such as film production and virtual reality, yet deploying its computationally intensive models on resource-constrained devices presents c…

cs.CV2025

Event-Priori-Based Vision-Language Model for Efficient Visual Understanding

Haotong Qin, Cheng Hu, Michele Magno

Large Language Model (LLM)-based Vision-Language Models (VLMs) have substantially extended the boundaries of visual understanding capabilities. However, their high computational de…

cs.CV2025

PicoSAM2: Low-Latency Segmentation In-Sensor for Edge Vision Applications

Pietro Bonazzi, Nicola Farronato, Stefan Zihlmann +2

Real-time, on-device segmentation is critical for latency-sensitive and privacy-aware applications like smart glasses and IoT devices. We introduce PicoSAM2, a lightweight (1.3M pa…

cs.CV2025

Q-SAM2: Accurate Quantization for Segment Anything Model 2

Nicola Farronato, Florian Scheidegger, Mattia Rigotti +3

The Segment Anything Model 2 (SAM2) is a powerful foundation model for promptable segmentation. However, its high computational and memory costs are a major barrier to deployment o…

cs.CV2025

Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformers

Weilun Feng, Chuanguang Yang, Haotong Qin +8

Diffusion transformers (DiT) have demonstrated exceptional performance in video generation. However, their large number of parameters and high computational complexity limit their…

cs.LG2025

An Empirical Study of Qwen3 Quantization

Xingyu Zheng, Yuye Li, Haoran Chu +7

The Qwen series has emerged as a leading family of open-source Large Language Models (LLMs), demonstrating remarkable capabilities in natural language understanding tasks. With the…

cs.RO2025

Robust Reinforcement Learning-Based Locomotion for Resource-Constrained Quadrupeds with Exteroceptive Sensing

Davide Plozza, Patricia Apostol, Paul Joseph +2

Compact quadrupedal robots are proving increasingly suitable for deployment in real-world scenarios. Their smaller size fosters easy integration into human environments. Neverthele…

cs.RO2025

FSDP: Fast and Safe Data-Driven Overtaking Trajectory Planning for Head-to-Head Autonomous Racing Competitions

Cheng Hu, Jihao Huang, Wule Mao +7

Generating overtaking trajectories in autonomous racing is a challenging task, as the trajectory must satisfy the vehicle's dynamics and ensure safety and real-time performance run…

cs.CV2024

MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Models

Weilun Feng, Haotong Qin, Chuanguang Yang +7

Diffusion models have received wide attention in generation tasks. However, the expensive computation cost prevents the application of diffusion models in resource-constrained scen…

cs.LG2024★ 1 cited

GWQ: Gradient-Aware Weight Quantization for Large Language Models

Yihua Shao, Yan Gu, Siyu Chen +12

Large language models (LLMs) show impressive performance in solving complex language tasks. However, its large number of parameters presents significant challenges for the deployme…

cs.AI2024★ 4 cited

A Survey of Low-bit Large Language Models: Basics, Systems, and Algorithms

Ruihao Gong, Yifu Ding, Zining Wang +7

Large language models (LLMs) have achieved remarkable advancements in natural language processing, showcasing exceptional performance across various tasks. However, the expensive m…