5 citations · 9 across the 10 of their papers we have counts for
4 papers · 1 filter
KV-Repurpose: A Testbed for Evaluating Non-Prefix KV-Cache Reuse
Taiga Ikeda, Daisuke Miyashita, Jun Deguchi
KV-cache reuse in large language model serving is commonly limited to exact prompt prefixes, preventing reuse when the same retrieved document appears after different system prompt…
SimplyRetrieve: A Private and Lightweight Retrieval-Centric Generative AI Tool
Youyang Ng, Daisuke Miyashita, Yasuto Hoshi +4
Large Language Model (LLM) based Generative AI systems have seen significant progress in recent years. Integrating a knowledge retrieval architecture allows for seamless integratio…
RaLLe: A Framework for Developing and Evaluating Retrieval-Augmented Large Language Models
Yasuto Hoshi, Daisuke Miyashita, Youyang Ng +4
Retrieval-augmented large language models (R-LLMs) combine pre-trained large language models (LLMs) with information retrieval systems to improve the accuracy of factual question-a…
Can a Frozen Pretrained Language Model be used for Zero-shot Neural Retrieval on Entity-centric Questions?
Yasuto Hoshi, Daisuke Miyashita, Yasuhiro Morioka +3
Neural document retrievers, including dense passage retrieval (DPR), have outperformed classical lexical-matching retrievers, such as BM25, when fine-tuned and tested on specific q…