50 citations · 53 across the 6 of their papers we have counts for
7 papers
GRIT -- Geometry-Aware PEFT with K-FACPreconditioning, Fisher-Guided Reprojection, andDynamic Rank Adaptation
Pritish Saha, Chandrav Rajbangshi, Rudra Goyal +6
Parameter-efficient fine-tuning (PEFT) is the default way to adapt LLMs, but widely used LoRA and QLoRA are largely geometry-agnostic: they optimize in fixed, randomly oriented low…
MapTrace: Scalable Data Generation for Route Tracing on Maps
Artemis Panagopoulou, Aveek Purohit, Achin Kulshrestha +2
While Multimodal Large Language Models have achieved human-like performance on many visual and textual reasoning tasks, their proficiency in fine-grained spatial understanding, suc…
Human Hands as Probes for Interactive Object Understanding
Mohit Goyal, Sahil Modi, Rishabh Goyal +1
Interactive object understanding, or what we can do to objects and how is a long-standing goal of computer vision. In this paper, we tackle this problem through observation of huma…
DZip: improved general-purpose lossless compression based on novel neural network modeling
Mohit Goyal, Kedar Tatwawadi, Shubham Chandak +1
We consider lossless compression based on statistical data modeling followed by prediction-based encoding, where an accurate statistical model for the input data leads to substanti…
Learning Activation Functions: A new paradigm for understanding Neural Networks
Mohit Goyal, Rajan Goyal, Brejesh Lall
The scope of research in the domain of activation functions remains limited and centered around improving the ease of optimization or generalization quality of neural networks (NNs…
DeepZip: Lossless Data Compression using Recurrent Neural Networks
Mohit Goyal, Kedar Tatwawadi, Shubham Chandak +1
Sequential data is being generated at an unprecedented pace in various forms, including text and genomic data. This creates the need for efficient compression mechanisms to enable…
Detection of Glottal Closure Instants from Raw Speech using Convolutional Neural Networks
Mohit Goyal, Varun Srivastava, Prathosh A. P
Glottal Closure Instants (GCIs) correspond to the temporal locations of significant excitation to the vocal tract occurring during the production of voiced speech. GCI detection fr…