1 citations · 1 across the 8 of their papers we have counts for
5 papers · 1 filter
TreeCoders: Trees of Transformers
Pierre Colonna D'Istria, Abdulrahman Altahhan
In this paper, we introduce TreeCoders, a novel family of transformer trees. We moved away from traditional linear transformers to complete k-ary trees. Transformer blocks serve as…
Emotion Recognition with Facial Attention and Objective Activation Functions
Andrzej Miskow, Abdulrahman Altahhan
In this paper, we study the effect of introducing channel and spatial attention mechanisms, namely SEN-Net, ECA-Net, and CBAM, to existing CNN vision-based models such as VGGNet, R…
A Comparison of Baseline Models and a Transformer Network for SOC Prediction in Lithium-Ion Batteries
Hadeel Aboueidah, Abdulrahman Altahhan
Accurately predicting the state of charge of Lithium-ion batteries is essential to the performance of battery management systems of electric vehicles. One of the main reasons for t…
Mitigating Vanishing Activations in Deep CapsNets Using Channel Pruning
Siddharth Sahu, Abdulrahman Altahhan
Capsule Networks outperform Convolutional Neural Networks in learning the part-whole relationships with viewpoint invariance, and the credit goes to their multidimensional capsules…
A Neural Network Alternative to Tree-based Models
Salvatore Raieli, Nathalie Jeanray, Stéphane Gerart +2
Tabular datasets are widely used in scientific disciplines such as biology. While these disciplines have already adopted AI methods to enhance their findings and analysis, they mai…