6 papers
Linearized 2-Simplicial Attention
Aritra Das, Dhruman Gupta, Debayan Gupta
We present a linearized form of 2-simplicial attention by rewriting the trilinear score as an inner product between a composite query and a key, so that the sum over one token axis…
A Rate Separation for Agnostic Direct Sums
Mihir More, Aritra Das, Debayan Gupta
Hanneke, Moran, and Waknine \cite{HannekeMoranWaknine2024} asked how the agnostic PAC learning curve of the direct sum depends on the single-instance learning curve $\epsagn(…
Joint 3D Gravity and Magnetic Inversion via Rectified Flow and Ginzburg-Landau Guidance
Dhruman Gupta, Yashas Shende, Aritra Das +2
Subsurface ore detection is of paramount importance given the rising depletion of shallow mineral resources in recent years. It is crucial to explore approaches that go beyond the…
Does Order Matter : Connecting The Law of Robustness to Robust Generalization
Mihir More, Aritra Das, Jaee Ponde +3
Bubeck and Selke (2021) propose the connection between the Law of Robustness and robust generalization error as an open problem. The Law of Robustness states that overparameterizat…
Physics Aware Neural Networks: Denoising for Magnetic Navigation
Aritra Das, Yashas Shende, Muskaan Chugh +3
Magnetic-anomaly navigation, leveraging small-scale variations in the Earth's magnetic field, is a promising alternative when GPS is unavailable or compromised. Airborne systems fa…
Oscillators Are All You Need: Irregular Time Series Modelling via Damped Harmonic Oscillators with Closed-Form Solutions
Yashas Shende, Aritra Das, Reva Laxmi Chauhan +2
Transformers excel at time series modelling through attention mechanisms that capture long-term temporal patterns. However, they assume uniform time intervals and therefore struggl…