158 citations · 181 across the 19 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.IR2024★ 1 cited
Intermediate Distillation: Data-Efficient Distillation from Black-Box LLMs for Information Retrieval
Zizhong Li, Haopeng Zhang, Jiawei Zhang
Recent research has explored distilling knowledge from large language models (LLMs) to optimize retriever models, especially within the retrieval-augmented generation (RAG) framewo…
cs.CL2024★ 11 cited
A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models
Haopeng Zhang, Philip S. Yu, Jiawei Zhang
Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language…
cs.CL2024
Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generation
Zizhong Li, Haopeng Zhang, Jiawei Zhang
Retrieval-augmented generation framework can address the limitations of large language models by enabling real-time knowledge updates for more accurate answers. An efficient way in…