most citedPosition-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs

2 citations · 2 across the 9 of their papers we have counts for

collaborators

10 papers

cs.AI2026

Next Thoughts Are Distributions: Generative Autoregressive Reasoning in the Latent Space

Yang Li, Yi Wang, Shiyuan Huang +3

Reasoning problems often admit multiple valid ways to proceed. Continuous reasoning promises to move computation beyond language tokens into a more compact latent space, but repres…

cs.LG2026

SaFeR-Steer: Evolving Multi-Turn MLLMs via Synthetic Bootstrapping and Feedback Dynamics

Haolong Hu, Hanyu Li, Tiancheng He +6

MLLMs are increasingly deployed in multi-turn settings, where attackers can escalate unsafe intent through the evolving visual-text history and exploit long-context safety decay. Y…

cs.CL2026

Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models

Yang Liu, Hongming Li, Melissa Xiaohui Qin +2

We present SemanticQA, an evaluation suite designed to assess language models (LMs) in semantic phrase processing tasks. The benchmark consolidates existing multiword expression (M…

cs.AI2026

LACE: Lattice Attention for Cross-thread Exploration

Yang Li, Zirui Zhang, Yang Liu +1

Current large language models reason in isolation. Although it is common to sample multiple reasoning paths in parallel, these trajectories do not interact, and often fail in the s…

cs.LG2026

M100: An Orchestrated Dataflow Architecture Powering General AI Computing

Yan Xie, Changkui Mao, Changsong Wu +34

As deep learning-based AI technologies gain momentum, the demand for general-purpose AI computing architectures continues to grow. While GPGPU-based architectures offer versatility…

cs.CL2026

Beyond "I Don't Know": Evaluating LLM Self-Awareness in Discriminating Data and Model Uncertainty

Jingyi Ren, Ante Wang, Yunghwei Lai +5

Reliable Large Language Models (LLMs) should abstain when confidence is insufficient. However, prior studies often treat refusal as a generic "I don't know'', failing to distinguis…

cs.SE2026

Structural Anchors and Reasoning Fragility:Understanding CoT Robustness in LLM4Code

Yang Liu, Da Song, Armstrong Foundjem +2

Chain-of-Thought (CoT) prompting is widely used to elicit explicit reasoning from large language models for code (LLM4Code). However, its impact on robustness and the stability of…

cs.LG2026

The Past Is Not Past: Memory-Enhanced Dynamic Reward Shaping

Yang Liu, Enxi Wang, Yufei Gao +6

Despite the success of reinforcement learning for large language models, a common failure mode is reduced sampling diversity, where the policy repeatedly generates similar erroneou…

cs.AI2024

Skywork-Math: Data Scaling Laws for Mathematical Reasoning in Large Language Models -- The Story Goes On

Liang Zeng, Liangjun Zhong, Liang Zhao +9

In this paper, we investigate the underlying factors that potentially enhance the mathematical reasoning capabilities of large language models (LLMs). We argue that the data scalin…

cs.CL2024★ 2 cited

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs

Zheng Zhang, Fan Yang, Ziyan Jiang +5

Recent advances in large language models (LLMs) have enhanced their ability to process long input contexts. This development is particularly crucial for tasks that involve retrievi…