Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases
Dong Liu, Yanxuan Yu
Vector databases (VecDBs) are increasingly deployed in retrieval-augmented generation (RAG) pipelines where query processing and document ingestion occur concurrently. The index la…
cs.CL2025
CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
Dong Liu, Shu Wang, Yanxuan Yu +2
Large language models face significant computational bottlenecks during inference due to the expensive output layer computation over large vocabularies. We present CSV-Decode, a no…
cs.CL2025
SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Modeling
Dong Liu, Yanxuan Yu
Tokenization plays a critical role in language modeling, yet existing approaches such as Byte-Pair Encoding (BPE) or WordPiece operate purely on frequency statistics, ignoring the…