7 citations · 9 across the 6 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 7 cited
A survey of deep learning optimizers -- first and second order methods
Rohan Kashyap
Deep Learning optimization involves minimizing a high-dimensional loss function in the weight space which is often perceived as difficult due to its inherent difficulties such as s…
cs.CL2022★ 2 cited
GPT-Neo for commonsense reasoning -- a theoretical and practical lens
Rohan Kashyap, Vivek Kashyap, Narendra C. P.
Recent work has demonstrated substantial gains in pre-training large-language models (LLMs) followed by supervised fine-tuning on the downstream task. In this paper, we evaluate th…