9 citations · 19 across the 10 of their papers we have counts for
11 papers
Fisher8: Stabilizing Neural Heteroscedastic Regression via Output-Layer Fisher Geometry
Sumedh Vemuganti, Nickvash Kani
Training neural networks to jointly predict mean and uncertainty estimates from noisy observations can be unstable, prompting a series of independent stabilization efforts. We argu…
GiVA: Gradient-Informed Bases for Vector-Based Adaptation
Neeraj Gangwar, Rishabh Deshmukh, Michael Shavlovsky +4
As model sizes continue to grow, parameter-efficient fine-tuning has emerged as a powerful alternative to full fine-tuning. While LoRA is widely adopted among these methods, recent…
Parameter-Efficient Multi-Task Learning via Progressive Task-Specific Adaptation
Neeraj Gangwar, Anshuka Rangi, Rishabh Deshmukh +3
Parameter-efficient fine-tuning methods have emerged as a promising solution for adapting pre-trained models to various downstream tasks. While these methods perform well in single…
Integrating Arithmetic Learning Improves Mathematical Reasoning in Smaller Models
Neeraj Gangwar, Suma P Bhat, Nickvash Kani
While large models pre-trained on high-quality data exhibit excellent performance on mathematical reasoning (e.g., GSM8k, MultiArith), it remains challenging to specialize smaller…
E-Gen: Leveraging E-Graphs to Improve Continuous Representations of Symbolic Expressions
Hongbo Zheng, Suyuan Wang, Neeraj Gangwar +1
Vector representations have been pivotal in advancing natural language processing (NLP), with prior research focusing on embedding techniques for mathematical expressions using mat…
STEM-POM: Evaluating Language Models Math-Symbol Reasoning in Document Parsing
Jiaru Zou, Qing Wang, Pratyush Thakur +1
Advances in large language models (LLMs) have spurred research into enhancing their reasoning capabilities, particularly in math-rich STEM (Science, Technology, Engineering, and Ma…
Mathematical Derivation Graphs: A Relation Extraction Task in STEM Manuscripts
Vishesh Prasad, Brian Kim, Nickvash Kani
Recent advances in natural language processing (NLP), particularly with the emergence of large language models (LLMs), have significantly enhanced the field of textual analysis. Ho…
Highlighting Named Entities in Input for Auto-Formulation of Optimization Problems
Neeraj Gangwar, Nickvash Kani
Operations research deals with modeling and solving real-world problems as mathematical optimization problems. While solving mathematical systems is accomplished by analytical soft…
Semantic Representations of Mathematical Expressions in a Continuous Vector Space
Neeraj Gangwar, Nickvash Kani
Mathematical notation makes up a large portion of STEM literature, yet finding semantic representations for formulae remains a challenging problem. Because mathematical notation is…
Clocked Magnetostriction-Assisted Spintronic Device Design and Simulation
Rouhollah Mousavi Iraei, Nickvash Kani, Sourav Dutta +5
We propose a heterostructure device comprised of magnets and piezoelectrics that significantly improves the delay and the energy dissipation of an all-spin logic (ASL) device. This…
A Probability-Density Function Approach to Capture the Stochastic Dynamics of the Nanomagnet and Impact on Circuit Performance
Nickvash Kani, Shaloo Rakheja, Azad Naeemi
In this paper we systematically evaluate the variation in the reversal delay of a nanomagnet driven by a longitudinal spin current while under the influence of thermal noise. We th…