21 citations · 60 across the 8 of their papers we have counts for
5 papers · 1 filter
Cardinality-Stratified Interaction Decomposition for Interpretable Pairwise and Higher-Order Structure in Transactional Basket Data
Hidetoshi Kawase, Toshihiro Ota
Transactional basket data can reveal associations among items, but observed co-occurrence conflates item-specific relations with basket-size structure and unmodeled higher-order de…
Phases in a class of associative memories via hidden neurons
Toshihiro Ota, Masato Taki
Associative memory in the Hopfield network is attractor dynamics in a disordered many-body system, and higher-order and exponential extensions turn its retrieval update into softma…
Collective Kernel EFT for Pre-activation ResNets
Hidetoshi Kawase, Toshihiro Ota
In finite-width deep neural networks, the empirical kernel evolves stochastically across layers. We develop a collective kernel effective field theory (EFT) for pre-activation…
iMixer: hierarchical Hopfield network implies an invertible, implicit and iterative MLP-Mixer
Toshihiro Ota, Masato Taki
In the last few years, the success of Transformers in computer vision has stimulated the discovery of many alternative models that compete with Transformers, such as the MLP-Mixer.…
Attention in a family of Boltzmann machines emerging from modern Hopfield networks
Toshihiro Ota, Ryo Karakida
Hopfield networks and Boltzmann machines (BMs) are fundamental energy-based neural network models. Recent studies on modern Hopfield networks have broaden the class of energy funct…