2 papers
cs.LG2026
HAServe: Horizon-Aware Scheduling and Memory Co-Design for Efficient LLM Serving
Xingyu Qu, Tianhao Lin, Yiqi Li +2
Online large language model (LLM) services process requests that share context but differ in prefix structure and arrival timing. Finite capacity couples request admission and key-…
cs.DB2024
Approximate Vector Set Search Inspired by Fly Olfactory Neural System
Yiqi Li, Sheng Wang, Zhiyu Chen +2
Vector set search, an underexplored similarity search paradigm, aims to find vector sets similar to a query set. This search paradigm leverages the inherent structural alignment be…