7 citations · 9 across the 7 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.IR2023
Efficient Title Reranker for Fast and Improved Knowledge-Intense NLP
Ziyi Chen, Jize Jiang, Daqian Zuo +3
In recent RAG approaches, rerankers play a pivotal role in refining retrieval accuracy with the ability of revealing logical relations for each pair of query and text. However, exi…
cs.LG2023★ 2 cited
Cascade Speculative Drafting for Even Faster LLM Inference
Ziyi Chen, Xiaocong Yang, Jiacheng Lin +3
Introduced to enhance the efficiency of large language model (LLM) inference, speculative decoding operates by having a smaller model generate a draft. A larger target model then r…