2 citations · 5 across the 20 of their papers we have counts for
11 papers · 1 filter
REWIND: Uncertainty-Guided Trajectory Repair for Test-Time Reasoning
Yi Ding, Mengyu Wang, Min Zhou +1
An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to improve output quality by sa…
ConWriter: Transition-Constrained Stateful Long-Form Story Generation with Lightweight Neuro-Symbolic Consistency Control
Jindong Li, Yang Yang, Zihao Liu +2
Long-form story generation requires models to preserve narrative consistency across extended contexts, yet existing prompting-based methods often accumulate temporal, factual, char…
Learning When Not to Listen: Selective Anti-Interference Pretraining for Language Models
Jinchang Zhu, Haowei He, Yi Ding +5
Language models can over-condition on irrelevant preceding text: predictions already supported by local context may still change when distant, unrelated prefix tokens are perturbed…
FCPRAG: Fusion-Controller Parametric Retrieval-Augmented Generation for Stable Multi-Passage LoRA Injection
Jinchang Zhu, Jindong Li, Yi Ding +5
Parametric retrieval-augmented generation (PRAG) injects retrieved evidence into a large language model (LLM) through passage-specific LoRA adapters, reducing reliance on long in-c…
StorySpark: Module-wise Evolutionary Search for Story Premise Generation
Yang Yang, Zining Zhong, Qian Cao +5
A story premise is the creative spark from which a full narrative can grow. Yet LLM-based story generation has mostly emphasized later-stage planning, controllability, coherence, a…
Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining
Jinchang Zhu, Jindong Li, Yuwen Hao +3
A causal-decoder block is hierarchical: lower layers build the residual basis that upper layers attend over. We identify a failure mode in GPT pretraining: upper layers commit to s…
Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing
Jinchang Zhu, Jindong Li, Chengyu Zou +4
Long-context adaptation is often viewed as window scaling, but this misses a token-level supervision mismatch: in packed training with document masking, each target token's effecti…
HeLa-Mem: Hebbian Learning and Associative Memory for LLM Agents
Jinchang Zhu, Jindong Li, Cheng Zhang +2
Long-term memory is a critical challenge for Large Language Model agents, as fixed context windows cannot preserve coherence across extended interactions. Existing memory systems r…
Continuous Knowledge Metabolism: Generating Scientific Hypotheses from Evolving Literature
Jinkai Tao, Yubo Wang, Xiaoyu Liu +1
Identifying promising research directions in fast-moving subareas is one of the most cognitively expensive tasks in modern AI research. Existing LLM-driven scientific discovery sys…
HyperbolicRAG: Enhancing Retrieval-Augmented Generation with Hyperbolic Representations
Linxiao Cao, Ruitao Wang, Jindong Li +2
Retrieval-augmented generation (RAG) enables large language models (LLMs) to access external knowledge, helping mitigate hallucinations and enhance domain-specific expertise. Graph…
Implicit Reasoning in Large Language Models: A Comprehensive Survey
Jindong Li, Yali Fu, Li Fan +6
Large Language Models (LLMs) have demonstrated strong generalization across a wide range of tasks. Reasoning with LLMs is central to solving multi-step problems and complex decisio…