109 citations · 217 across the 36 of their papers we have counts for
10 papers · 1 filter
Theory and Algorithms for Pulse Signal Processing
Gabriel Nallathambi, Jose C. Principe
The integrate and fire converter transforms an analog signal into train of biphasic pulses. The pulse train has information encoded in the timing and polarity of pulses. While it h…
Simple stopping criteria for information theoretic feature selection
Shujian Yu, Jose C. Principe
Feature selection aims to select the smallest feature subset that yields the minimum generalization error. In the rich literature in feature selection, information theory-based app…
Multivariate Extension of Matrix-based Renyi's α-order Entropy Functional
Shujian Yu, Luis Gonzalo Sanchez Giraldo, Robert Jenssen +1
The matrix-based Renyi's α-order entropy functional was recently introduced using the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel H…
Request-and-Reverify: Hierarchical Hypothesis Testing for Concept Drift Detection with Expensive Labels
Shujian Yu, Xiaoyang Wang, Jose C. Principe
One important assumption underlying common classification models is the stationarity of the data. However, in real-world streaming applications, the data concept indicated by the j…
A Taxonomy for Neural Memory Networks
Ying Ma, Jose Principe
In this paper, a taxonomy for memory networks is proposed based on their memory organization. The taxonomy includes all the popular memory networks: vanilla recurrent neural networ…
Understanding Convolutional Neural Networks with Information Theory: An Initial Exploration
Shujian Yu, Kristoffer Wickstrøm, Robert Jenssen +1
The matrix-based Renyi's α-entropy functional and its multivariate extension were recently developed in terms of the normalized eigenspectrum of a Hermitian matrix of the projected…