9 papers
ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning
Ziyan Liu, Xueda Shen, Yuzhe Gu +7
Large Reasoning Models (LRMs) have achieved remarkable progress thanks to Reinforcement Learning with Verifiable Rewards (RLVR) on Chain-of-Thoughts (CoTs). However, since long CoT…
CAREAgent: Clinical Agent with Structured Reasoning and Tool-Integrated for Order Generation
Ruihui Hou, Ziyue Huai, Chennuo Zhang +5
Clinical order generation serves as a critical bridge between clinical decision-making and real-world practice, translating medical decisions into concrete and executable orders. E…
Committed SAE-Feature Traces for Audited-Session Substitution Detection in Hosted LLMs
Ziyang Liu
Hosted-LLM providers have a silent-substitution incentive: advertise a stronger model while serving cheaper replies. Probe-after-return schemes such as SVIP leave a parallel-serve…
Copy-as-Decode: Grammar-Constrained Parallel Prefill for LLM Editing
Ziyang Liu
LLMs edit text and code by autoregressively regenerating the full output, even when most tokens appear verbatim in the input. We study Copy-as-Decode, a decoding-layer mechanism th…
Depth Registers Unlock W4A4 on SwiGLU: A Reader/Generator Decomposition
Ziyang Liu
We study post-training W4A4 quantization in a controlled 300M-parameter SwiGLU decoder-only language model trained on 5B tokens of FineWeb-Edu, and ask which input-activation sites…
Cooperative Memory Paging with Keyword Bookmarks for Long-Horizon LLM Conversations
Ziyang Liu
When LLM conversations grow beyond the context window, old content must be evicted -- but how does the model recover it when needed? We propose cooperative paging: evicted segments…