3 citations · 4 across the 2 of their papers we have counts for
2 papers
cs.LG2022★ 1 cited
Linear Self-Attention Approximation via Trainable Feedforward Kernel
Uladzislau Yorsh, Alexander Kovalenko
In pursuit of faster computation, Efficient Transformers demonstrate an impressive variety of approaches -- models attaining sub-quadratic attention complexity can utilize a notion…
cs.LG2021★ 3 cited
Dynamic Neural Diversification: Path to Computationally Sustainable Neural Networks
Alexander Kovalenko, Pavel Kordík, Magda Friedjungová
Small neural networks with a constrained number of trainable parameters, can be suitable resource-efficient candidates for many simple tasks, where now excessively large models are…