7 papers
KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasing
Mufei Li, Shikun Liu, Dongqi Fu +5
Post-hoc context erasing over the KV cache is challenging because a local edit has a global consequence: once a span has been processed, its influence propagates into the cached st…
Towards Direct Latent-Space Synthesis for Parallel Branches in LLM-Agent Workflows
Shikun Liu, Mufei Li, Dongqi Fu +5
Large language models increasingly serve as execution engines for agentic systems, yet they still consume context through a sequential text interface. This creates a mismatch with…
Structural Alignment Improves Graph Test-Time Adaptation
Hans Hao-Hsun Hsu, Shikun Liu, Han Zhao +1
Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades…
Graph-KV: Breaking Sequence via Injecting Structural Biases into Large Language Models
Haoyu Wang, Peihao Wang, Mufei Li +4
Modern large language models (LLMs) are inherently auto-regressive, requiring input to be serialized into flat sequences regardless of their structural dependencies. This serializa…
RoFt-Mol: Benchmarking Robust Fine-Tuning with Molecular Graph Foundation Models
Shikun Liu, Deyu Zou, Nima Shoghi +3
In the era of foundation models, fine-tuning pre-trained models for specific downstream tasks has become crucial. This drives the need for robust fine-tuning methods to address cha…
Struc-EMB: The Potential of Structure-Aware Encoding in Language Embeddings
Shikun Liu, Haoyu Wang, Mufei Li +1
Text embeddings from Large Language Models (LLMs) have become foundational for numerous applications. However, these models typically operate on raw text, overlooking the rich stru…