9 papers
MMShopBench: A Real-Log Benchmark for Multimodal, Multi-Turn Shopping Agents
Zeying Hao, Hao Guo, Mengtao Xu +5
Online shoppers increasingly turn to AI shopping assistants, using images and multi-turn dialogue to express and refine product needs that are difficult to articulate in text alone…
SkillChain: Closing the Loop on Skill Evolution for Image-Based E-Commerce AI Assistants
Yimin Hu, Mengtao Xu, Hao Guo +3
Image-based AI assistants are now deployed at production scale on e-commerce platforms, where a single uploaded image can trigger fundamentally different user intents: product sear…
Procedural Knowledge Is Not Low-Rank: Why LoRA Fails to Internalize Multi-Step Procedures
Simon Dennis, Kevin Shabahang, Hao Guo +1
Parameter-efficient fine-tuning methods like LoRA have become the default for adapting large language models, succeeding across instruction following, style transfer, and factual a…
When Mean CE Fails: Median CE Can Better Track Language Model Quality
Hao Guo, Simon Dennis, Rivaan Patil +1
Mean cross-entropy is the standard validation metric for language models, but it can fail to track model quality during training. We examine this in two common scenarios. First, in…
Beyond Inference-Only Deployment: Comparing Weight-Based Consolidation Against Cascading Compaction
Simon Dennis, Kevin Shabahang, Hao Guo +1
Major LLM platforms deploy models in an inference-only configuration: the model serves requests but never updates per-user weights. Users must repeatedly re-teach preferences, corr…
Compiling Agentic Workflows into LLM Weights: Near-Frontier Quality at Two Orders of Magnitude Less Cost
Simon Dennis, Rivaan Patil, Kevin Shabahang +1
Agent orchestration frameworks have proliferated, collectively exceeding 290,000 GitHub stars across LangGraph, CrewAI, Google ADK, OpenAI Agents SDK, Semantic Kernel, Strands, and…