activity
20242026
most citedSoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training

1 citations · 1 across the 12 of their papers we have counts for

collaborators

17 papers

cs.LG2026

Exact Risk Certificates for Pairwise-Judged Reranking

Xinyu Wang, Jingrui Tian, Sicheng Lyu +4

Pairwise relevance judgments constrain both the loss numerator and the ideal-ranking denominator of nDCG. We characterize the exact worst-case loss of replacing a ranking with a fi…

cs.LG2026

Measuring the Task Value of Precision Upgrades in Closed-Loop Agents

Sicheng Lyu, Xinyu Wang, Yu Gu +3

A low-precision agent can call its full-precision (BF16) model at selected decisions as a fallback. A learned precision router chooses where to call it from the disagreement betwee…

cs.LG2026

A Refresh Interval Does Not Fully Specify a Refresh Schedule: Learning-Rate-Dependent Placement in Kronecker-Preconditioned Language Model Training

Xinyu Wang, Zhiwei Zhai, Yu Gu +6

Kronecker-preconditioned optimizers recompute a cached curvature eigendecomposition only periodically, and implementations and adaptive methods control this through the refresh fre…

cs.CL2026

Sequential Functional Structured Tucker Compression for Large Language Model Attentions

Jiangfeng Chen, Xinyu Wang, Tianshuo Yan +4

Post-training compression of LLM attention is often formulated as independent matrix approximation, ignoring both the shared structure among attention projections and the represent…

cs.AI2026

FINSKILLOPS: A Self-Evolving Multi-Agent System for SEC Filing QA

Yanzhang Ma, Zhenghan Tai, Hanwei Wu +25

Financial QA systems are typically improved before deployment through better retrieval, prompting, or agent coordination, leaving their reliability behavior fixed thereafter. In pr…

cs.IR2026

FinSAgent: Corpus-Aligned Multi-Agent RAG Framework for Evidence-Grounded SEC Filing Question Answering

Jijun Chi, Zhenghan Tai, Hanwei Wu +21

Financial question answering over U.S. Securities and Exchange Commission (SEC) filings requires retrieving and synthesizing heterogeneous evidence dispersed across long, standardi…

cs.SD2026

WQ-Fusion: Dynamic Gated Attention for Cross-Domain Audio Representation

Mingda Lin, Lei Ding, Xinyue Zhou +6

While pre-trained models excel in specialized tasks, learning universal representations across diverse acoustic domains remains challenging. To address this, we propose WQ-Fusion,…

stat.ML2026

AURA: Adaptive Uncertainty-aware Refinement for LLM-as-a-Judge Auditing

Zilong Zhang, Yi-Ting Hung, Weiyi He +3

Large language models (LLMs) are increasingly used as judges for open-ended generation, as large-scale human evaluation is often expensive and difficult to scale, yet their prefere…

stat.ML2026

Quantifying and Auditing LLM Evaluation via Positive--Unlabeled Learning

Zilong Zhang, Yi-Ting Hung, Lei Ding +1

Large Language Models (LLMs) are increasingly used as judges for scalable evaluation, yet such LLM--as--a--Judge systems exhibit systematic biases that are decoupled from semantic…

cs.AI2026

From Table to Cell: Attention for Better Reasoning with TABALIGN

Tung Sum Thomas Kwok, Zeyong Zhang, Xinyu Wang +6

Multi-step LLM reasoning over structured tables fails because planning and execution share no explicit cell-grounding contract. Existing methods constrain the planner to a left-to-…

cs.AI2026

Enhancing Table Reasoning with Deterministic Table-State Rewards

Tung Sum Thomas Kwok, Xinyu Wang, Hengzhi He +9

Large Language Models (LLMs) struggle with multi-step reasoning over structured tables. The primary reason is the lack of explicit supervision for intermediate reasoning states. Ex…

cs.SD2026

Diagnostic-Driven Layer-Wise Compensation for Post-Training Quantization of Encoder-Decoder ASR Models

Xinyu Wang, Ziyu Zhao, Yajie Luo +6

Layer-wise post-training quantization reconstructs each layer from inputs already altered by the quantized prefix. QEP compensates for this drift with one model-wide coefficient, c…

cs.CL2025

: A Route-to-Rerank Post-Training Framework for Multi-Domain Decoder-Only Rerankers

Xinyu Wang, Hanwei Wu, Qingchen Hu +13

Decoder-only rerankers are central to Retrieval-Augmented Generation (RAG). However, generalist models miss domain-specific nuances in high-stakes fields like finance and law, and…

cs.IR2025

VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering

Zhenghan Tai, Hanwei Wu, Qingchen Hu +24

Retrieval-Augmented Generation (RAG) is becoming increasingly essential for Question Answering (QA) in the financial sector, where accurate and contextually grounded insights from…

cs.LG2025

It Takes Two: Your GRPO Is Secretly DPO

Yihong Wu, Liheng Ma, Lei Ding +9

GRPO has emerged as a prominent reinforcement learning algorithm for post-training LLMs. Unlike critic-based methods, GRPO computes advantages by estimating the \emph{value baselin…

cs.CL2025

Advancing Multi-Agent RAG Systems with Minimalist Reinforcement Learning

Yihong Wu, Liheng Ma, Muzhi Li +7

Large Language Models (LLMs) equipped with modern Retrieval-Augmented Generation (RAG) systems often employ multi-turn interaction pipelines to interface with search engines for co…

cs.CL2024★ 1 cited

SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training

Nan He, Weichen Xiong, Hanwen Liu +6

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and…