9 citations · 10 across the 3 of their papers we have counts for
5 papers · 1 filter
Reinforcement Learning for LLM Post-Training: A Survey
Zhichao Wang, Kiran Ramnath, Bin Bi +9
Large language models (LLMs) trained via pretraining and supervised fine-tuning (SFT) can still produce harmful and misaligned outputs, or struggle in domains like math and coding.…
UFT: Unifying Fine-Tuning of SFT and RLHF/DPO/UNA through a Generalized Implicit Reward Function
Zhichao Wang, Bin Bi, Zixu Zhu +6
By pretraining on trillions of tokens, an LLM gains the capability of text generation. However, to enhance its utility and reduce potential harm, SFT and alignment are applied sequ…
Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Models
Aliyah R. Hsu, James Zhu, Zhichao Wang +11
LLMs have demonstrated impressive proficiency in generating coherent and high-quality text, making them valuable across a range of text-generation tasks. However, rigorous evaluati…
Diversity Enhances an LLM's Performance in RAG and Long-context Task
Zhichao Wang, Bin Bi, Yanqi Luo +2
The rapid advancements in large language models (LLMs) have highlighted the challenge of context window limitations, primarily due to the quadratic time complexity of the self-atte…
PAFT: A Parallel Training Paradigm for Effective LLM Fine-Tuning
Shiva Kumar Pentyala, Zhichao Wang, Bin Bi +6
Large language models (LLMs) have shown remarkable abilities in diverse natural language processing (NLP) tasks. The LLMs generally undergo supervised fine-tuning (SFT) followed by…