8 citations · 9 across the 12 of their papers we have counts for
3 papers · 1 filter
When Does Disaggregation Pay? Simulating Prefill--Decode--Attention--FFN Specialization for Agentic LLM Inference
Przemyslaw Forys, Haoran Wu, Can Xiao +8
Agentic inference now dominates the LLM inference landscape, requiring LLMs to actively engage in multi-turn interactions with tool-calling capabilities. This introduces a more com…
CascadeLUT: Information-Ordered Streaming Inference for Bandwidth-Constrained FPGAs
Oliver Cassidy, Marta Andronic, George A. Constantinides
Mapping neural networks to FPGAs enables low-latency, energy-efficient inference, particularly for lookup table (LUT)-based models that eliminate multipliers and map directly to re…
Direction-Preserving Number Representations
Bardia Zadeh, George A. Constantinides
Low-precision number formats are widely used in modern machine learning systems due to their efficiency. Accurate direction representation is key to the accuracy of vector operatio…