4 papers
From Craft to Kernel: A Governance-First Execution Architecture and Semantic ISA for Agentic Computers
Xiangyu Wen, Yuang Zhao, Xiaoyu Xu +9
The transition of agentic AI from brittle prototypes to production systems is stalled by a pervasive crisis of craft. We suggest that the prevailing orchestration paradigm-delegati…
MCPMark: A Benchmark for Stress-Testing Realistic and Comprehensive MCP Use
Zijian Wu, Xiangyan Liu, Xinyuan Zhang +12
MCP standardizes how LLMs interact with external systems, forming the foundation for general agents. However, existing MCP benchmarks remain narrow in scope: they focus on read-hea…
SCBench: A Sports Commentary Benchmark for Video LLMs
Kuangzhi Ge, Lingjun Chen, Kevin Zhang +6
Recently, significant advances have been made in Video Large Language Models (Video LLMs) in both academia and industry. However, methods to evaluate and benchmark the performance…
Is Self-knowledge and Action Consistent or Not: Investigating Large Language Model's Personality
Yiming Ai, Zhiwei He, Ziyin Zhang +5
In this study, we delve into the validity of conventional personality questionnaires in capturing the human-like personality traits of Large Language Models (LLMs). Our objective i…