7 citations · 9 across the 9 of their papers we have counts for
5 papers · 1 filter
Robust Molecular Property Prediction via Densifying Scarce Labeled Data
Jina Kim, Jeffrey Willette, Bruno Andreis +1
A widely recognized limitation of molecular prediction models is their reliance on structures observed in the training data, resulting in poor generalization to out-of-distribution…
Delta Attention: Fast and Accurate Sparse Attention Inference by Delta Correction
Jeffrey Willette, Heejun Lee, Sung Ju Hwang
The attention mechanism of a transformer has a quadratic complexity, leading to high inference costs and latency for long sequences. However, attention matrices are mostly sparse,…
Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation
Jeffrey Willette, Seanie Lee, Bruno Andreis +3
Recent work on mini-batch consistency (MBC) for set functions has brought attention to the need for sequentially processing and aggregating chunks of a partitioned set while guaran…
Mini-Batch Consistent Slot Set Encoder for Scalable Set Encoding
Bruno Andreis, Jeffrey Willette, Juho Lee +1
Most existing set encoding algorithms operate under the implicit assumption that all the set elements are accessible, and that there are ample computational and memory resources to…
Improving Uncertainty Calibration via Prior Augmented Data
Jeffrey Willette, Juho Lee, Sung Ju Hwang
Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their pre…