1 citations · 1 across the 2 of their papers we have counts for
3 papers
Better Models, Faster Training: Sigmoid Attention for single-cell Foundation Models
Vijay Sadashivaiah, Georgios Dasoulas, Judith Mueller +1
Training stable biological foundation models requires rethinking attention mechanisms: we find that using sigmoid attention as a drop in replacement for softmax attention a) produc…
Explaining Chest X-ray Pathology Models using Textual Concepts
Vijay Sadashivaiah, Pingkun Yan, James A. Hendler
Deep learning models have revolutionized medical imaging and diagnostics, yet their opaque nature poses challenges for clinical adoption and trust. Amongst approaches to improve mo…
Auto-Transfer: Learning to Route Transferrable Representations
Keerthiram Murugesan, Vijay Sadashivaiah, Ronny Luss +3
Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be diffic…