4 papers
SpecBench: Evaluating Specification-Level Reasoning for Software Engineering LLM Agents
Grant Hamblin, Kevin Song, Zhanda Zhu +4
Software engineering (SWE) agents are transitioning from code generation to full software development lifecycle automation. A critical phase in this lifecycle is specification desi…
Aegis: Taxonomy and Optimizations for Overcoming Agent-Environment Failures in LLM Agents
Kevin Song, Anand Jayarajan, Yaoyao Ding +4
Large Language Models (LLMs) agents augmented with domain tools promise to autonomously execute complex tasks requiring human-level intelligence, such as customer service and digit…
HybridTier: an Adaptive and Lightweight CXL-Memory Tiering System
Kevin Song, Jiacheng Yang, Zixuan Wang +3
Modern workloads are demanding increasingly larger memory capacity. Compute Express Link (CXL)-based memory tiering has emerged as a promising solution for addressing this problem…
FreeRide: Harvesting Bubbles in Pipeline Parallelism
Jiashu Zhang, Zihan Pan, Molly +3
The occurrence of bubbles in pipeline parallelism is an inherent limitation that can account for more than 40% of the large language model (LLM) training time and is one of the mai…