Better Queries, Cheaper Attention: Adapting Transformers for Efficient Sparse Reconstruction

Philippa Duckett, Samuel Van Stroud, Max Hart +2

Query-based transformer decoders are effective for object reconstruction from sparse scientific sensor measurements, but their scalability to high-multiplicity data is limited by f…