6 citations · 21 across the 13 of their papers we have counts for
6 papers · 1 filter
Score Broadcast and Decorrelation: A General Framework for Broadcast-Based Credit Assignment
Mustafa Uzun, Mete Erdogan, Cengiz Pehlevan +1
We introduce Score Broadcast and Decorrelation (SBD), a principled framework for broadcast-based credit assignment for general families of differentiable losses. Error broadcast is…
Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling
Indranil Halder, Cengiz Pehlevan
Recent developments in large language models have shown advantages in reallocating a notable share of computational resource from training time to inference time. However, the prin…
Error Broadcast and Decorrelation as a Potential Artificial and Natural Learning Mechanism
Mete Erdogan, Cengiz Pehlevan, Alper T. Erdogan
We introduce Error Broadcast and Decorrelation (EBD), a novel learning framework for neural networks that addresses credit assignment by directly broadcasting output errors to indi…
Pixel-Based Similarities as an Alternative to Neural Data for Improving Convolutional Neural Network Adversarial Robustness
Elie Attias, Cengiz Pehlevan, Dina Obeid
Convolutional Neural Networks (CNNs) excel in many visual tasks but remain susceptible to adversarial attacks-imperceptible perturbations that degrade performance. Prior research r…
Attention Approximates Sparse Distributed Memory
Trenton Bricken, Cengiz Pehlevan
While Attention has come to be an important mechanism in deep learning, there remains limited intuition for why it works so well. Here, we show that Transformer Attention can be cl…
Associative Memory in Iterated Overparameterized Sigmoid Autoencoders
Yibo Jiang, Cengiz Pehlevan
Recent work showed that overparameterized autoencoders can be trained to implement associative memory via iterative maps, when the trained input-output Jacobian of the network has…