5 papers
NeuroGame Transformer: Gibbs-Inspired Attention Driven by Game Theory and Statistical Physics
Djamel Bouchaffra, Faycal Ykhlef, Hanene Azzag +2
Standard attention mechanisms in transformers are limited by their pairwise formulation, which hinders the modeling of higher-order dependencies among tokens. We introduce the Neur…
Manual Verbalizer Enrichment for Few-Shot Text Classification
Quang Anh Nguyen, Nadi Tomeh, Mustapha Lebbah +3
With the continuous development of pre-trained language models, prompt-based training becomes a well-adopted paradigm that drastically improves the exploitation of models for many…
Evaluating the Efficacy of Instance Incremental vs. Batch Learning in Delayed Label Environments: An Empirical Study on Tabular Data Streaming for Fraud Detection
Kodjo Mawuena Amekoe, Mustapha Lebbah, Gregoire Jaffre +2
Real-world tabular learning production scenarios typically involve evolving data streams, where data arrives continuously and its distribution may change over time. In such a setti…
Adaptative Context Normalization: A Boost for Deep Learning in Image Processing
Bilal Faye, Hanane Azzag, Mustapha Lebbah +1
Deep Neural network learning for image processing faces major challenges related to changes in distribution across layers, which disrupt model convergence and performance. Activati…
Unsupervised Adaptive Normalization
Bilal Faye, Hanane Azzag, Mustapha Lebbah +1
Deep neural networks have become a staple in solving intricate problems, proving their mettle in a wide array of applications. However, their training process is often hampered by…