1 citations · 1 across the 3 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
ProteinJEPA: Latent prediction improves protein language model pretraining
Dan Ofer, Dafna Shahaf, Michal Linial
Protein language models are trained primarily with masked language modeling (MLM), which predicts masked amino-acid identities. Joint-embedding predictive architectures (JEPA) inst…
cs.LG2026
ProtSent: Protein Sentence Transformers
Dan Ofer, Oriel Perets, Michal Linial +1
Protein language models produce rich per-residue representations, but the sequence embeddings obtained by mean-pooling them are never trained to place related proteins near one ano…