3 citations · 3 across the 16 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
Dong Liu, Shu Wang, Yanxuan Yu +2
Large language models face significant computational bottlenecks during inference due to the expensive output layer computation over large vocabularies. We present CSV-Decode, a no…
cs.CL2025
SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases
Dong Liu, Yanxuan Yu
Vector databases (VecDBs) are increasingly deployed in retrieval-augmented generation (RAG) pipelines where query processing and document ingestion occur concurrently. The index la…