1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2024★ 1 cited
QQQ: Quality Quattuor-Bit Quantization for Large Language Models
Ying Zhang, Peng Zhang, Mincong Huang +7
Quantization is a proven effective method for compressing large language models. Although popular techniques like W8A8 and W4A16 effectively maintain model performance, they often…
cs.LG2024
Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe
Mincong Huang, Chao Wang, Chi Ma +3
Pipeline parallelism is an essential technique in the training of large-scale Transformer models. However, it suffers from imbalanced memory consumption, leading to insufficient me…