17 citations · 21 across the 34 of their papers we have counts for
5 papers · 1 filter
SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization
Jintao Zhang, Haofeng Huang, Pengle Zhang +3
Although quantization for linear layers has been widely used, its application to accelerate the attention process remains limited. To further enhance the efficiency of attention co…
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
Jintao Zhang, Jia Wei, Haofeng Huang +3
The transformer architecture predominates across various models. As the heart of the transformer, attention has a computational complexity of , compared to for linea…
AutoCE: An Accurate and Efficient Model Advisor for Learned Cardinality Estimation
Jintao Zhang, Chao Zhang, Guoliang Li +1
Cardinality estimation (CE) plays a crucial role in many database-related tasks such as query generation, cost estimation, and join ordering. Lately, we have witnessed the emergenc…
PACE: Poisoning Attacks on Learned Cardinality Estimation
Jintao Zhang, Chao Zhang, Guoliang Li +1
Cardinality estimation (CE) plays a crucial role in database optimizer. We have witnessed the emergence of numerous learned CE models recently which can outperform traditional meth…
HTAP Databases: A Survey
Chao Zhang, Guoliang Li, Jintao Zhang +2
Since Gartner coined the term, Hybrid Transactional and Analytical Processing (HTAP), numerous HTAP databases have been proposed to combine transactions with analytics in order to…