2 papers
cs.AR2021
GNNerator: A Hardware/Software Framework for Accelerating Graph Neural Networks
Jacob R. Stevens, Dipankar Das, Sasikanth Avancha +2
Graph Neural Networks (GNNs) use a fully-connected layer to extract features from the nodes of a graph and aggregate these features using message passing between nodes, combining t…
cs.AR2021
Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers
Jacob R. Stevens, Rangharajan Venkatesan, Steve Dai +2
Transformers have transformed the field of natural language processing. This performance is largely attributed to the use of stacked self-attention layers, each of which consists o…