6 papers
Multi-Agent Empowerment and Emergence of Complex Behavior in Groups
Tristan Shah, Ilya Nemenman, Daniel Polani +1
Intrinsic motivations are receiving increasing attention, i.e. behavioral incentives that are not engineered, but emerge from the interaction of an agent with its surroundings. In…
Randomness with constraints: constructing minimal models for high-dimensional biology
Ilya Nemenman, Pankaj Mehta
Biologists and physicists have a rich tradition of modeling living systems with simple models composed of a few interacting components. Despite the remarkable success of this appro…
Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
Eslam Abdelaleem, Ilya Nemenman, K. Michael Martini
Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both su…
Physics-tailored machine learning reveals unexpected physics in dusty plasmas
Wentao Yu, Eslam Abdelaleem, Ilya Nemenman +1
Dusty plasma is a mixture of ions, electrons, and macroscopic charged particles that is commonly found in space and planetary environments. The particles interact through Coulomb f…
Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learning
Eslam Abdelaleem, Ahmed Roman, K. Michael Martini +1
We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR me…
Generative random latent features models and statistics of natural images
Philipp Fleig, Ilya Nemenman
Complex, multivariable systems are often analyzed by grouping their constituent units into components, sometimes referred to as latent features, which afford physical or biological…