492 citations · 722 across the 9 of their papers we have counts for
4 papers · 1 filter
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Leo Gao, Stella Biderman, Sid Black +9
Recent work has demonstrated that increased training dataset diversity improves general cross-domain knowledge and downstream generalization capability for large-scale language mod…
Value Function Based Performance Optimization of Deep Learning Workloads
Benoit Steiner, Chris Cummins, Horace He +1
As machine learning techniques become ubiquitous, the efficiency of neural network implementations is becoming correspondingly paramount. Frameworks, such as Halide and TVM, separa…
Combining Label Propagation and Simple Models Out-performs Graph Neural Networks
Qian Huang, Horace He, Abhay Singh +2
Graph Neural Networks (GNNs) are the predominant technique for learning over graphs. However, there is relatively little understanding of why GNNs are successful in practice and wh…
Better Set Representations For Relational Reasoning
Qian Huang, Horace He, Abhay Singh +3
Incorporating relational reasoning into neural networks has greatly expanded their capabilities and scope. One defining trait of relational reasoning is that it operates on a set o…