10 citations · 14 across the 12 of their papers we have counts for
4 papers · 1 filter
KVComm: Enabling Efficient LLM Communication through Selective KV Sharing
Xiangyu Shi, Marco Chiesa, Gerald Q. Maguire +1
Large Language Models (LLMs) are increasingly deployed in multi-agent systems, where effective inter-model communication is crucial. Existing communication protocols either rely on…
Priority-Aware Preemptive Scheduling for Mixed-Priority Workloads in MoE Inference
Mohammad Siavashi, Faezeh Keshmiri Dindarloo, Dejan Kostic +1
Large Language Models have revolutionized natural language processing, yet serving them efficiently in data centers remains challenging due to mixed workloads comprising latency-se…
Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning
Laura Puccioni, Alireza Farshin, Mariano Scazzariello +3
Large Language Models (LLMs) have demonstrated their exceptional performance in various complex code generation tasks. However, their broader adoption is limited by significant com…
FMM-Head: Enhancing Autoencoder-based ECG anomaly detection with prior knowledge
Giacomo Verardo, Magnus Boman, Samuel Bruchfeld +4
Detecting anomalies in electrocardiogram data is crucial to identifying deviations from normal heartbeat patterns and providing timely intervention to at-risk patients. Various Aut…