10 citations · 32 across the 21 of their papers we have counts for
8 papers · 1 filter
RLHFSpec: Breaking the Efficiency Bottleneck in RLHF Training via Adaptive Drafting
Siqi Wang, Hailong Yang, Junjie Zhu +3
Reinforcement Learning from Human Feedback (RLHF) is an important fine-tuning technique for large language models (LLMs) and comprises three stages: generation, inference, and trai…
xGR: Efficient Generative Recommendation Serving at Scale
Qingxiao Sun, Tongxuan Liu, Shen Zhang +13
Recommendation system delivers substantial economic benefits by providing personalized predictions. Generative recommendation (GR) integrates LLMs to enhance the understanding of l…
Accelerating Sparse Transformer Inference on GPU
Wenhao Dai, Haodong Deng, Mengfei Rong +6
Large language models (LLMs) are popular around the world due to their powerful understanding capabilities. As the core component of LLMs, accelerating Transformer through parallel…
Quantum Machine Learning in Log-based Anomaly Detection: Challenges and Opportunities
Jiaxing Qi, Chang Zeng, Zhongzhi Luan +6
Log-based anomaly detection (LogAD) is the main component of Artificial Intelligence for IT Operations (AIOps), which can detect anomalous that occur during the system on-the-fly.…
LogGPT: Exploring ChatGPT for Log-Based Anomaly Detection
Jiaxing Qi, Shaohan Huang, Zhongzhi Luan +3
The increasing volume of log data produced by software-intensive systems makes it impractical to analyze them manually. Many deep learning-based methods have been proposed for log-…
FamilySeer: Towards Optimized Tensor Codes by Exploiting Computation Subgraph Similarity
Shanjun Zhang, Mingzhen Li, Hailong Yang +3
Deploying various deep learning (DL) models efficiently has boosted the research on DL compilers. The difficulty of generating optimized tensor codes drives DL compiler to ask for…