5 papers
A Timing-Anomaly Free Dynamic Scheduling on Heterogeneous Systems
Yixuan Zhu, Yinkang Gao, Lei Gong +9
Heterogeneous systems commonly adopt dynamic scheduling algorithms to improve resource utilization and enhance scheduling flexibility. However, such flexibility may introduce timin…
Reducing End-to-End Latency of Cause-Effect Chains with Shared Cache Analysis
Yixuan Zhu, Yinkang Gao, Bo Zhang +8
Cause-effect chains, as a widely used modeling method in real-time embedded systems, are extensively applied in various safety-critical domains. End-to-end latency, as a key real-t…
Crystal-KV: Efficient KV Cache Management for Chain-of-Thought LLMs via Answer-First Principle
Zihan Wang, Cheng Tang, Lei Gong +5
Chain-of-Thought (CoT) reasoning in large language models (LLMs) significantly improves accuracy on complex tasks, yet incurs excessive memory overhead due to the long think-stage…
CoQMoE: Co-Designed Quantization and Computation Orchestration for Mixture-of-Experts Vision Transformer on FPGA
Jiale Dong, Hao Wu, Zihao Wang +5
Vision Transformers (ViTs) exhibit superior performance in computer vision tasks but face deployment challenges on resource-constrained devices due to high computational/memory dem…
UbiMoE: A Ubiquitous Mixture-of-Experts Vision Transformer Accelerator With Hybrid Computation Pattern on FPGA
Jiale Dong, Wenqi Lou, Zhendong Zheng +4
Compared to traditional Vision Transformers (ViT), Mixture-of-Experts Vision Transformers (MoE-ViT) are introduced to scale model size without a proportional increase in computatio…