1 citations · 1 across the 4 of their papers we have counts for
5 papers
Underscoring the Problem: Why Softpick Fails at Initialization
Aryan Sood, Jaikaran Singh, Ishaan Bansal
Softmax attention gives every token a nonzero weight, which in trained models concentrates into attention sinks and massive activations that widen the dynamic range low-precision i…
Generating Adversarial Texts for Machine Translation via GRPO
Florian Zogaj, Jakob Hütteneder, Giovanni De Muri +3
As machine translation (MT) systems continue to improve, standard benchmarks become less informative for exposing remaining weaknesses. Traditional methods for creating challenging…
Dropping the Anchor: Statistical Context Summarization for Distributed Systems via Pulsar Attention
Aryan Sood, Shantanu Acharya, Gaurav Kumar Nayak
Inference with large language models (LLMs) on long sequences is computationally expensive due to the quadratic complexity of self-attention. Distributed blockwise methods such as…
Lost in Interpolation: Why Predictive Feedback Fails in Diffusion Language Models
Lavanya Nigam, Ishaan Bansal, Aryan Sood +2
Soft-masking accelerates the convergence of Masked Diffusion Language Models (MDLMs). Existing formulations build this blend with linear interpolation (LERP) in the raw embedding s…
CuRIOS-ED: The Technology Demonstrator for the CubeSats for Rapid Infrared and Optical Surveys Mission
Hannah Gulick, Jessica R. Lu, Aryan Sood +9
The rise of time-domain astronomy including electromagnetic counterparts to gravitational waves, gravitational microlensing, explosive phenomena, and even astrometry with Gaia, are…