4 papers
UnionSparse: An Index-Efficient Sparsity Framework for Low-Bit Sparse LLM Inference on Edge
Tianhao Jiang, Hang Gu, Teng Wang +9
Edge LLM inference combines sparsity and low-bit quantization to meet device memory, latency, and power limits. Yet quantization shrinks weight payloads without proportionally redu…
Scheduling Cause-Effect Chains without Timing Anomalies in End-to-End Latency
Yixuan Zhu, Bo Zhang, Yinkang Gao +7
In real-time systems, both individual task execution and data propagation must meet strict timing constraints. Cause-effect (CE) chains are widely used to analyze such behaviors by…
A Timing-Anomaly Free Dynamic Scheduling on Heterogeneous Systems
Yixuan Zhu, Yinkang Gao, Lei Gong +9
Heterogeneous systems commonly adopt dynamic scheduling algorithms to improve resource utilization and enhance scheduling flexibility. However, such flexibility may introduce timin…
Crystal-KV: Efficient KV Cache Management for Chain-of-Thought LLMs via Answer-First Principle
Zihan Wang, Cheng Tang, Lei Gong +5
Chain-of-Thought (CoT) reasoning in large language models (LLMs) significantly improves accuracy on complex tasks, yet incurs excessive memory overhead due to the long think-stage…