4 papers
Formalizing the Binding Problem
Lianghuan Huang, Yihao Li, Saeed Salehi +3
Representations of the world, arguably, contain information about features (e.g. something is blue, something is a circle) but also information about which features are part of the…
Estimating Implicit Regularization in Deep Learning
Joseph H. Rudoler, Kevin Tan, Giles Hooker +1
Deep learning systems are known to exhibit implicit regularization (alt. implicit bias), favoring simple solutions instead of merely minimizing the loss function. In some cases, we…
Who Does What in Deep Learning? Multidimensional Game-Theoretic Attribution of Function of Neural Units
Shrey Dixit, Kayson Fakhar, Fatemeh Hadaeghi +3
Neural networks now generate text, images, and speech with billions of parameters, producing a need to know how each neural unit contributes to these high-dimensional outputs. Exis…
Falcon: Fractional Alternating Cut with Overcoming Minima in Unsupervised Segmentation
Xiao Zhang, Xiangyu Han, Xiwen Lai +3
Today's unsupervised image segmentation algorithms often segment suboptimally. Modern graph-cut based approaches rely on high-dimensional attention maps from Transformer-based foun…