5 papers
Energy-Regularized Spatial Masking: A Novel Approach to Enhancing Robustness and Interpretability in Vision Models
Tom Devynck, Bilal Faye, Djamel Bouchaffra +3
Deep convolutional neural networks achieve remarkable performance by exhaustively processing dense spatial feature maps, yet this brute-force strategy introduces significant comput…
Coalition Free Energy and Adaptive Precision in Multi-Agent Cooperation
Djamel Bouchaffra, Faycal Ykhlef, Mustapha Lebbah +1
Cooperative multi-agent systems require robust mechanisms for credit assignment under uncertainty. Here we introduce a variational framework, termed the Game-Theoretic Free Energy…
A Game Theoretic Free Energy Analysis of Higher Order Synergy in Attention Heads of Large Language Models
Djamel Bouchaffra
Large language models rely on multihead attention, but interactions among heads remain poorly understood. We apply the Game Theoretic Free Energy Principle (GTFEP): a framework cas…
A Collective Variational Principle Unifying Bayesian Inference, Game Theory, and Thermodynamics
Djamel Bouchaffra, Faycal Ykhlef, Mustapha Lebbah +1
Collective intelligence emerges across biological, physical, and artificial systems without central coordination, yet a unifying principle governing such behaviour remains elusive.…
NeuroGame Transformer: Gibbs-Inspired Attention Driven by Game Theory and Statistical Physics
Djamel Bouchaffra, Faycal Ykhlef, Hanene Azzag +2
Standard attention mechanisms in transformers are limited by their pairwise formulation, which hinders the modeling of higher-order dependencies among tokens. We introduce the Neur…