40 citations · 74 across the 7 of their papers we have counts for
4 papers · 1 filter
Correcting Influence: Unboxing LLM Outputs with Orthogonal Latent Spaces
Shixing Yu, Promit Ghosal, Kyra Gan
A critical step for reliable large language models (LLMs) use in healthcare is to attribute predictions to their training data, akin to a medical case study. This requires token-le…
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
Kaiyu Yang, Aidan M. Swope, Alex Gu +6
Large language models (LLMs) have shown promise in proving formal theorems using proof assistants such as Lean. However, existing methods are difficult to reproduce or build on, du…
Regularizing Deep Neural Networks with Stochastic Estimators of Hessian Trace
Yucong Liu, Shixing Yu, Tong Lin
In this paper, we develop a novel regularization method for deep neural networks by penalizing the trace of Hessian. This regularizer is motivated by a recent guarantee bound of th…
Unified Visual Transformer Compression
Shixing Yu, Tianlong Chen, Jiayi Shen +5
Vision transformers (ViTs) have gained popularity recently. Even without customized image operators such as convolutions, ViTs can yield competitive performance when properly train…