11 citations · 21 across the 11 of their papers we have counts for
4 papers · 1 filter
Flexible Online Representation Learning Based on Similarity Matching
Shagesh Sridharan, Yanis Bahroun, Anirvan M. Sengupta
Sparse high-dimensional representations are conducive to uncovering nontrivial structures in unsupervised exploration of data. Such a representation can deal with the dense connect…
Attention as In-Context Empirical Bayes: A Two-Stage View via Particle Dynamics
Matthew Smart, Soumya Ganguly, Nilava Metya +2
We study minimal attention-only transformers under all-token corruption and show they admit a two-stage empirical Bayes interpretation. A single attention step computes a kernel-we…
In-context denoising with one-layer transformers: connections between attention and associative memory retrieval
Matthew Smart, Alberto Bietti, Anirvan M. Sengupta
We introduce in-context denoising, a task that refines the connection between attention-based architectures and dense associative memory (DAM) networks, also known as modern Hopfie…
Deep Learning Based Superconductivity: Prediction and Experimental Tests
Daniel Kaplan, Adam Zhang, Joanna Blawat +6
The discovery of novel superconducting materials is a longstanding challenge in materials science, with a wealth of potential for applications in energy, transportation, and comput…