28 citations · 56 across the 11 of their papers we have counts for
7 papers · 1 filter
SOLO: Pretraining Billion-Parameter Language Models with Shared-Output Local Learning
Bojian Yin, Shurong Wang, Yuqi Pan +1
Large language models are trained with backpropagation, whose global gradient coordinates all layers but forces each to hold its activations and wait for the gradient to pass back…
Modern Transformers Are Implicit Hybrids: From Functional Differentiation to Principled Hybrid Architecture Design
Runlin Shi, Bojian Yin, Guoqi Li
Hybrid architectures combining Full Attention (FA) and Linear Attention (LA) are increasingly prominent, yet their allocation remains heuristic. We seek an evidence-grounded basis…
Efficient Sparse Selective-Update RNNs for Long-Range Sequence Modeling
Bojian Yin, Shurong Wang, Haoyu Tan +3
Real-world sequential signals, such as audio or video, contain critical information that is often embedded within long periods of silence or noise. While recurrent neural networks…
Traces Propagation: Memory-Efficient and Scalable Forward-Only Learning in Spiking Neural Networks
Lorenzo Pes, Bojian Yin, Sander Stuijk +1
Spiking Neural Networks (SNNs) provide an efficient framework for processing dynamic spatio-temporal signals and for investigating the learning principles underlying biological neu…
Stochastic Layer-wise Learning: Scalable and Efficient Alternative to Backpropagation
Bojian Yin, Federico Corradi
Backpropagation underpins modern deep learning, yet its reliance on global gradient synchronization limits scalability and incurs high memory costs. In contrast, fully local learni…
Never Reset Again: A Mathematical Framework for Continual Inference in Recurrent Neural Networks
Bojian Yin, Federico Corradi
Recurrent Neural Networks (RNNs) are widely used for sequential processing but face fundamental limitations with continual inference due to state saturation, requiring disruptive h…
An image representation based convolutional network for DNA classification
Bojian Yin, Marleen Balvert, Davide Zambrano +2
The folding structure of the DNA molecule combined with helper molecules, also referred to as the chromatin, is highly relevant for the functional properties of DNA. The chromatin…