most citedEffective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation

1 citations · 1 across the 5 of their papers we have counts for

collaborators

5 papers

eess.SY2025

Modeling and Mixed-Integer Nonlinear MPC of Positive-Negative Pressure Pneumatic Systems

Yu Mei, Xinyu Zhou, Xiaobo Tan

Positive-negative pressure regulation is critical to soft robotic actuators, enabling large motion ranges and versatile actuation modes. However, it remains challenging due to comp…

cs.LG2025

Private Model Personalization Revisited

Conor Snedeker, Xinyu Zhou, Raef Bassily

We study model personalization under user-level differential privacy (DP) in the shared representation framework. In this problem, there are users whose data is statistically h…

physics.optics2025

Overcoming Intrinsic Dispersion Locking for Achieving Spatio-Spectral Selectivity with Misaligned Bi-metagratings

Ze-Peng Zhuang, Xin Zhou, Hao-Long Zeng +6

Spatio-spectral selectivity, the capability to select a single mode with a specific wavevector (angle) and wavelength, is imperative for light emission and imaging. Continuous band…

cs.CL20251 cited

Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation

Yi Lu, Wanxu Zhao, Xin Zhou +9

Large Language Models (LLMs) often struggle to process and generate coherent context when the number of input tokens exceeds the pre-trained length. Recent advancements in long-con…

cs.LG2023

ABS-SGD: A Delayed Synchronous Stochastic Gradient Descent Algorithm with Adaptive Batch Size for Heterogeneous GPU Clusters

Xin Zhou, Ling Chen, Houming Wu

As the size of models and datasets grows, it has become increasingly common to train models in parallel. However, existing distributed stochastic gradient descent (SGD) algorithms…