7 papers
Action Chunk Scheduling for Batched Robot Policy Serving
Rohan Bansal, David He, Nadun Ranawaka Arachchige +4
Deploying robot foundation models at scale is the next step towards realizing the potential of general-purpose robots. However, Vision-Language-Action (VLA) and other foundation mo…
Stream2LLM: Overlap Context Streaming and Prefill for Reduced Time-to-First-Token (TTFT)
Rajveer Bachkaniwala, Chengqi Luo, Richard So +2
Context retrieval systems for LLM inference face a critical challenge: high retrieval latency creates a fundamental tension between waiting for complete context (poor time-to-first…
Halo: Domain-Aware Query Optimization for Long-Context Question Answering
Pramod Chunduri, Francisco Romero, Ali Payani +2
Long-context question answering (QA) over lengthy documents is critical for applications such as financial analysis, legal review, and scientific research. Current approaches, such…
ActionEngine: From Reactive to Programmatic GUI Agents via State Machine Memory
Hongbin Zhong, Fazle Faisal, Luis França +4
Existing Graphical User Interface (GUI) agents operate through step-by-step calls to vision language models--taking a screenshot, reasoning about the next action, executing it, the…
HONEYBEE: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning[Technical Report]
Hongbin Zhong, Matthew Lentz, Nina Narodytska +2
Enterprise deployments of vector databases require access control policies to protect sensitive data. These systems often implement access control through hybrid vector queries tha…
A Socratic RAG Approach to Connect Natural Language Queries on Research Topics with Knowledge Organization Systems
Lew Lefton, Kexin Rong, Chinar Dankhara +3
In this paper, we propose a Retrieval Augmented Generation (RAG) agent that maps natural language queries about research topics to precise, machine-interpretable semantic entities.…