11 citations · 19 across the 7 of their papers we have counts for
7 papers
UNDO: Understanding Distillation as Optimization
Kushal Jain, Piyushi Goyal, Kumar Shridhar
Knowledge distillation has emerged as an effective strategy for compressing large language models' (LLMs) knowledge into smaller, more efficient student models. However, standard o…
PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation
Kushal Kumar Jain, Ankith Varun J, Anoop Namboodiri
Portrait sketching involves capturing identity specific attributes of a real face with abstract lines and shades. Unlike photo-realistic images, a good portrait sketch generation m…
First-Step Advantage: Importance of Starting Right in Multi-Step Math Reasoning
Kushal Jain, Moritz Miller, Niket Tandon +1
Language models can solve complex reasoning tasks better by learning to generate rationales for their predictions. Often these models know how to solve a task but their auto-regres…
Face Cartoonisation For Various Poses Using StyleGAN
Kushal Jain, Ankith Varun J, Anoop Namboodiri
This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this fi…
Optimized EEG based mood detection with signal processing and deep neural networks for brain-computer interface
Subhrangshu Adhikary, Kushal Jain, Biswajit Saha +1
Electroencephalogram (EEG) is a very promising and widely implemented procedure to study brain signals and activities by amplifying and measuring the post-synaptical potential aris…
Learning to Drop Out: An Adversarial Approach to Training Sequence VAEs
Đorđe Miladinović, Kumar Shridhar, Kushal Jain +4
In principle, applying variational autoencoders (VAEs) to sequential data offers a method for controlled sequence generation, manipulation, and structured representation learning.…
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages
Kushal Jain, Adwait Deshpande, Kumar Shridhar +2
Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and t…