6 citations · 11 across the 17 of their papers we have counts for
4 papers · 1 filter
Parameter-free Adaptive Sparse Attention via Compression-Based Content Selection
Debarshi Kundu, Swaroop Ghosh, Vasant Honavar
Data-adaptive sparse attention masks substantially outperform fixed patterns (e.g., BigBird and Longformer) and can even exceed dense attention on long sequences. Existing adaptive…
Projection-Free Transformers via Gaussian Kernel Attention
Debarshi Kundu, Archisman Ghosh, Swaroop Ghosh +1
Self-attention in Transformers is typically implemented as , where , , and are learned linear projections of the input…
No Tile Left Behind: Multiprogramming for Surface-Code Architectures
Archisman Ghosh, Avimita Chatterjee, Swaroop Ghosh
Fault-tolerant quantum computing (FTQC) is emerging as the architectural regime in which practical large-scale quantum workloads will execute. In this setting, however, multiprogra…
Rings Around the Ancilla: A Workload-Aware FTQC Architecture
Archisman Ghosh, Avimita Chatterjee, Swaroop Ghosh
Obtaining a quantum advantage in practical applications over classical machines requires a fault-tolerant model of computation. However, the resource overhead of developing a fault…