4 papers · 1 filter
TEMPER: Tensorized Efficient Manifold-constrained Parameterization for Expressive Residual Routing
Yuxuan Gu, Wuyang Zhou, Huijun Xing +1
Residual connections rely on a static residual pathway, and are essential for training deep neural networks. Hyper-connections (HC) increase the expressivity of residual routing by…
Learning Pore-scale Multiphase Flow from 4D Velocimetry
Chunyang Wang, Linqi Zhu, Yuxuan Gu +9
Multiphase flow in porous media underpins subsurface energy and environmental technologies, including geological CO storage and underground hydrogen storage, yet pore-scale dyn…
Masked Auto-Regressive Variational Acceleration: Fast Inference Makes Practical Reinforcement Learning
Yuxuan Gu, Weimin Bai, Yifei Wang +2
Masked auto-regressive diffusion models (MAR) benefit from the expressive modeling ability of diffusion models and the flexibility of masked auto-regressive ordering. However, vani…
TeRA: Vector-based Random Tensor Network for High-Rank Adaptation of Large Language Models
Yuxuan Gu, Wuyang Zhou, Giorgos Iacovides +1
Parameter-Efficient Fine-Tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA), have significantly reduced the number of trainable parameters needed in fine-tuning large langua…