most citedUnraveling the Gradient Descent Dynamics of Transformers

1 citations · 1 across the 4 of their papers we have counts for

collaborators

5 papers

cs.CL2025

CrEst: Credibility Estimation for Contexts in LLMs via Weak Supervision

Dyah Adila, Shuai Zhang, Boran Han +2

The integration of contextual information has significantly enhanced the performance of large language models (LLMs) on knowledge-intensive tasks. However, existing methods often o…

cs.CV2025

Visual Instruction Tuning with Chain of Region-of-Interest

Yixin Chen, Shuai Zhang, Boran Han +1

High-resolution (HR) images are pivotal for enhancing the recognition and understanding capabilities of multimodal large language models (MLLMs). However, directly increasing image…

cs.LG2025

Adapting to Online Distribution Shifts in Deep Learning: A Black-Box Approach

Dheeraj Baby, Boran Han, Shuai Zhang +3

We study the well-motivated problem of online distribution shift in which the data arrive in batches and the distribution of each batch can change arbitrarily over time. Since the…

cs.CL2025

Effectively Steer LLM To Follow Preference via Building Confident Directions

Bingqing Song, Boran Han, Shuai Zhang +5

Having an LLM that aligns with human preferences is essential for accommodating individual needs, such as maintaining writing style or generating specific topics of interest. The m…

cs.LG20241 cited

Unraveling the Gradient Descent Dynamics of Transformers

Bingqing Song, Boran Han, Shuai Zhang +2

While the Transformer architecture has achieved remarkable success across various domains, a thorough theoretical foundation explaining its optimization dynamics is yet to be fully…