2 citations · 2 across the 4 of their papers we have counts for
4 papers
SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips
Jiahuan Yu, Mingtao Hu, Zichao Lin +1
Large Language Model (LLM) serving faces a fundamental tension between stringent latency Service Level Objectives (SLOs) and limited GPU memory capacity. When high request rates ex…
Compute-in-Memory Implementation of State Space Models for Event Sequence Processing
Xiaoyu Zhang, Mingtao Hu, Sen Lu +4
State space models (SSMs) have recently emerged as a powerful framework for long sequence processing, outperforming traditional methods on diverse benchmarks. Fundamentally, SSMs c…
State Space Models Naturally Produce Time Cell and Oscillatory Behaviors and Scale to Abstract Cognitive Functions
Sen Lu, Xiaoyu Zhang, Mingtao Hu +3
A grand challenge in modern neuroscience is bridging the gap between the microscale neural circuits and cognitive functions. While extensive knowledge exists about neuronal connect…
LLM-Mini-CEX: Automatic Evaluation of Large Language Model for Diagnostic Conversation
Xiaoming Shi, Jie Xu, Jinru Ding +9
There is an increasing interest in developing LLMs for medical diagnosis to improve diagnosis efficiency. Despite their alluring technological potential, there is no unified and co…