5 citations · 9 across the 22 of their papers we have counts for
5 papers · 1 filter
Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning
Dong Liu, Yanxuan Yu, Ying Nian Wu
The success of large language models (LLMs) across diverse NLP tasks has elevated the importance of reasoning chain optimization as a critical step in aligning model behavior with…
CSV-Decode: Certifiable Sub-Vocabulary Decoding for Efficient Large Language Model Inference
Dong Liu, Shu Wang, Yanxuan Yu +2
Large language models face significant computational bottlenecks during inference due to the expensive output layer computation over large vocabularies. We present CSV-Decode, a no…
SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases
Dong Liu, Yanxuan Yu
Vector databases (VecDBs) are increasingly deployed in retrieval-augmented generation (RAG) pipelines where query processing and document ingestion occur concurrently. The index la…
-Attention: Online Efficient Sparse Transformers for Long-Context Modeling
Pike D. Liu, Chang Liu, Yanxuan Yu
Sparse attention is crucial in long-context Transformers, which restricts each token to a limited neighborhood and thereby reduces the quadratic cost of full self-attention. Local…
SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Modeling
Dong Liu, Yanxuan Yu
Tokenization plays a critical role in language modeling, yet existing approaches such as Byte-Pair Encoding (BPE) or WordPiece operate purely on frequency statistics, ignoring the…