1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2026
STEM: Scaling Transformers with Embedding Modules
Ranajoy Sadhukhan, Sheng Cao, Harry Dong +5
Fine-grained sparsity promises higher parametric capacity without proportional per-token compute, but often suffers from training instability, load balancing, and communication ove…
cs.CV2023★ 1 cited
Semi-Supervised Relational Contrastive Learning
Attiano Purpura-Pontoniere, Demetri Terzopoulos, Adam Wang +1
Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-superv…