8 citations · 8 across the 4 of their papers we have counts for
6 papers
Emergence in Network Systems is Bounded by Boundary-Crossing Paths
Johnny Jingze Li, Gabriel A. Silva
Emergence, features of a whole that no part shows alone, is central to complex systems but rarely measured so as to locate its source. Viewing a system structurally, as a network o…
How Language Models Differ in Redistributing Attention-Head Activity Under Serial Demand
Johnny Jingze Li, Abdulla Kuleib, Kalyan Basu +1
The way a model distributes activity over each layer's attention heads offers a coarse view of how it routes information through depth; how this changes with the task is part of wh…
Quantifying Emergence in Neural Networks: Insights from Pruning and Training Dynamics
Faisal AlShinaifi, Zeyad Almoaigel, Johnny Jingze Li +2
Emergence, where complex behaviors develop from the interactions of simpler components within a network, plays a crucial role in enhancing neural network capabilities. We introduce…
Advancing Neural Network Performance through Emergence-Promoting Initialization Scheme
Johnny Jingze Li, Vivek Kurien George, Gabriel A. Silva
Emergence in machine learning refers to the spontaneous appearance of complex behaviors or capabilities that arise from the scale and structure of training data and model architect…
A Categorical Framework for Quantifying Emergent Effects in Network Topology
Johnny Jingze Li, Sebastian Prado Guerra, Kalyan Basu +1
Emergent effect is crucial to understanding the properties of complex systems that do not appear in their basic units, but there has been a lack of theories to measure and understa…
Computational efficiency of fractional diffusion using adaptive time step memory
Brian P. Sprouse, Christopher L. MacDonald, Gabriel A. Silva
Numerical solutions to fractional differential equations can be extremely computationally intensive due to the effect of non-local derivatives in which all previous time points con…