2 citations · 2 across the 2 of their papers we have counts for
2 papers
math.OC2021
On the Second-order Convergence Properties of Random Search Methods
Aurelien Lucchi, Antonio Orvieto, Adamos Solomou
We study the theoretical convergence properties of random-search methods when optimizing non-convex objective functions without having access to derivatives. We prove that standard…
cs.LG2021★ 2 cited
On Learning the Transformer Kernel
Sankalan Pal Chowdhury, Adamos Solomou, Avinava Dubey +1
In this work we introduce KERNELIZED TRANSFORMER, a generic, scalable, data driven framework for learning the kernel function in Transformers. Our framework approximates the Transf…