2 papers
cs.DB2026
VectraFlow: Long-Horizon Semantic Processing over Data and Event Streams with LLMs
Shu Chen, Junhan Liu, Deepti Raghavan +1
Monitoring continuous data for meaningful signals increasingly demands long-horizon, stateful reasoning over unstructured streams. However, today's LLM frameworks remain stateless…
cs.DC2024
Hermes: Memory-Efficient Pipeline Inference for Large Models on Edge Devices
Xueyuan Han, Zinuo Cai, Yichu Zhang +4
The application of Transformer-based large models has achieved numerous success in recent years. However, the exponential growth in the parameters of large models introduces formid…