3 citations · 3 across the 8 of their papers we have counts for
4 papers · 1 filter
Low-rank tensor structure of precipitation and its application to satellite-reference merging
Ryan Solgi, Rohan Shankar, Hugo A. Loaiciga
The intermittent and variable nature of precipitation makes its accurate estimation over extended domains difficult, yet its spatiotemporal structure suggests that a low-rank repre…
Tucker Bottleneck Attention for Multi-Dimensional Sequence Modeling
Ryan Solgi, Parsa Madinei, Zheng Zhang
The quadratic cost of self-attention limits scalability to long sequences from multidimensional data. We introduce Tucker bottleneck attention (TuBA), which exploits low-rank tenso…
LoRi: Low-Rank Distillation for Implicit Reasoning
Ryan Solgi, Jiayi Tian, Zheng Zhang
Implicit chain-of-thought (iCoT) methods aim to internalize reasoning in large language models, but often underperform explicit CoT prompting. We empirically find that hidden-state…
RankGuide: Tensor-Rank-Guided Routing and Steering for Efficient Reasoning
Jiayi Tian, Yupeng Su, Ryan Solgi +2
Large reasoning models (LRMs) enhance problem-solving capabilities by generating explicit multi-step chains of thought (CoT) reasoning; however, they incur substantial inference la…