6 papers
TextNCA: Neural Cellular Automata for Language Modeling via Hierarchical Local Attention
Avni Mittal, Avinash Anand, Ashutosh Kumar +7
Can a strictly local, iterated, weight-shared computation primitive support language modelling, and which of those three properties actually drives the model's behaviour? We define…
FORGE: Fused On-Register Gradient Elimination for Memory-Efficient LLM Training
Dikshant Kukreja, Kritarth Prasad, Avinash Anand +6
Reverse-mode differentiation computes every weight gradient, writes it to memory, and only then lets the optimizer read it back. This two-phase schedule sets the memory ceiling of…
Psychologically-Grounded Graph Modeling for Interpretable Depression Detection
Rishitej Reddy Vyalla, Kritarth Prasad, Avinash Anand +4
Automatic depression detection from conversational interactions holds significant promise for scalable screening but remains hindered by severe data scarcity and a lack of clinical…
Multilingual Mathematical Reasoning: Advancing Open-Source LLMs in Hindi and English
Avinash Anand, Kritarth Prasad, Chhavi Kirtani +4
Large Language Models (LLMs) excel in linguistic tasks but struggle with mathematical reasoning, particularly in non English languages like Hindi. This research aims to enhance the…
Enhancing LLMs for Physics Problem-Solving using Reinforcement Learning with Human-AI Feedback
Avinash Anand, Kritarth Prasad, Chhavi Kirtani +6
Large Language Models (LLMs) have demonstrated strong capabilities in text-based tasks but struggle with the complex reasoning required for physics problems, particularly in advanc…
Improving Multimodal LLMs Ability In Geometry Problem Solving, Reasoning, And Multistep Scoring
Avinash Anand, Raj Jaiswal, Abhishek Dharmadhikari +6
This paper presents GPSM4K, a comprehensive geometry multimodal dataset tailored to augment the problem-solving capabilities of Large Vision Language Models (LVLMs). GPSM4K encompa…