3 papers
cs.LG2026
Prism Transformer: Progressive Head Schedules for Hierarchical Attention Processing
Shubham Aggarwal
Multi-head attention conventionally partitions the hidden dimension equally across all heads at every layer, enforcing an identical representational subspace dimension (dh = dmodel…
cs.LG2026
Rethinking Attention Output Projection: Structured Hadamard Transforms for Efficient Transformers
Shubham Aggarwal, Lokendra Kumar
The dense output projection in multi head attention scales quadratically with model dimension, contributing significantly to parameter count, memory footprint, and inference cost.…
cs.CV2026
Hyper-Connections for Adaptive Multi-Modal MRI Brain Tumor Segmentation
Lokendra Kumar, Shubham Aggarwal
We present the first study of Hyper-Connections (HC) for volumetric multi-modal brain tumor segmentation, integrating them as a drop-in replacement for fixed residual connections a…