1 citations · 1 across the 4 of their papers we have counts for
5 papers
Regularization and compression of integral operator kernels with tensor paraproducts
Oluwadamilola Fasina, Ronald R. Coifman
We present a new perspective on integral operator kernels given by a nonlinear function of the distance. This perspective is useful since it permits one to quasilinearize the nonli…
Intrinsic and Extrinsic Organized Attention: Softmax Invariance and Network Sparsity
Oluwadamilola Fasina, Ruben V. C. Pohle, Pei-Chun Su +1
We examine the intrinsic (within the attention head) and extrinsic (amongst the attention heads) structure of the self-attention mechanism in transformers. Theoretical evidence for…
Extracting Dual Analytic Geometries of Linear Transformations to Achieve Efficient Computation
Pei-Chun Su, Ronald R. Coifman
We propose a novel framework for fast integral operations by uncovering hidden geometries in the row and column structures of the underlying operators. This is accomplished through…
On Learning what to Learn: heterogeneous observations of dynamics and establishing (possibly causal) relations among them
David W. Sroczynski, Felix Dietrich, Eleni D. Koronaki +4
Before we attempt to learn a function between two (sets of) observables of a physical process, we must first decide what the inputs and what the outputs of the desired function are…
Gappy local conformal auto-encoders for heterogeneous data fusion: in praise of rigidity
Erez Peterfreund, Iryna Burak, Ofir Lindenbaum +4
Fusing measurements from multiple, heterogeneous, partial sources, observing a common object or process, poses challenges due to the increasing availability of numbers and types of…