Showing cs.AIShow all
2 papers · 1 filter
cs.AI2025
Using Span Queries to Optimize for Cache and Attention Locality
Paul Castro, Nick Mitchell, Nathan Ordonez +3
Clients are evolving beyond chat completion, and now include a variety of innovative inference-time scaling and deep reasoning techniques. At the same time, inference servers remai…
cs.AI2023
Lights out: training RL agents robust to temporary blindness
N. Ordonez, M. Tromp, P. M. Julbe +1
Agents trained with DQN rely on an observation at each timestep to decide what action to take next. However, in real world applications observations can change or be missing entire…