7 citations · 29 across the 22 of their papers we have counts for
5 papers · 1 filter
Sparse Mamba: Introducing Controllability, Observability, And Stability To Structural State Space Models
Emadeldeen Hamdan, Hongyi Pan, Ahmet Enis Cetin
Structured state space models' (SSMs) development in recent studies, such as Mamba and Mamba2, outperformed and solved the computational inefficiency of transformers and large lang…
A novel asymmetrical autoencoder with a sparsifying discrete cosine Stockwell transform layer for gearbox sensor data compression
Xin Zhu, Daoguang Yang, Hongyi Pan +3
The lack of an efficient compression model remains a challenge for the wireless transmission of gearbox data in non-contact gear fault diagnosis problems. In this paper, we present…
Input Normalized Stochastic Gradient Descent Training of Deep Neural Networks
Salih Atici, Hongyi Pan, Ahmet Enis Cetin
In this paper, we propose a novel optimization algorithm for training machine learning models called Input Normalized Stochastic Gradient Descent (INSGD), inspired by the Normalize…
Block Walsh-Hadamard Transform Based Binary Layers in Deep Neural Networks
Hongyi Pan, Diaa Badawi, Ahmet Enis Cetin
Convolution has been the core operation of modern deep neural networks. It is well-known that convolutions can be implemented in the Fourier Transform domain. In this paper, we pro…
Robust Principal Component Analysis Using a Novel Kernel Related with the L1-Norm
Hongyi Pan, Diaa Badawi, Erdem Koyuncu +1
We consider a family of vector dot products that can be implemented using sign changes and addition operations only. The dot products are energy-efficient as they avoid the multipl…