37 citations · 74 across the 13 of their papers we have counts for
4 papers · 1 filter
Alopex: A Computational Framework for Enabling On-Device Function Calls with LLMs
Yide Ran, Zhaozhuo Xu, Yuhang Yao +9
The rapid advancement of Large Language Models (LLMs) has led to their increased integration into mobile devices for personalized assistance, which enables LLMs to call external AP…
ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency
Yuhang Yao, Han Jin, Alay Dilipbhai Shah +7
Large language models (LLMs) have surged in popularity and are extensively used in commercial applications, where the efficiency of model serving is crucial for the user experience…
TorchOpera: A Compound AI System for LLM Safety
Shanshan Han, Zijian Hu, Alay Dilipbhai Shah +5
We introduce TorchOpera, a compound AI system for enhancing the safety and quality of prompts and responses for Large Language Models. TorchOpera ensures that all user prompts are…
LLM Multi-Agent Systems: Challenges and Open Problems
Shanshan Han, Qifan Zhang, Weizhao Jin +1
This paper explores multi-agent systems and identify challenges that remain inadequately addressed. By leveraging the diverse capabilities and roles of individual agents, multi-age…