565 citations · 578 across the 6 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.LG2022★ 2 cited
MolCPT: Molecule Continuous Prompt Tuning to Generalize Molecular Representation Learning
Cameron Diao, Kaixiong Zhou, Zirui Liu +2
Molecular representation learning is crucial for the problem of molecular property prediction, where graph neural networks (GNNs) serve as an effective solution due to their struct…
cs.LG2022★ 6 cited
Relational Attention: Generalizing Transformers for Graph-Structured Tasks
Cameron Diao, Ricky Loynd
Transformers flexibly operate over sets of real-valued vectors representing task-specific entities and their attributes, where each vector might encode one word-piece token and its…
cs.CL2022★ 565 cited
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…