1 paper
Henry Ndubuaku, Karen Mosoyan, Jakub Mroz +5
Feed-forward networks hold two thirds of a transformer's non-embedding parameters, yet the architecture has not received a necessity test that controls parameters, compute, and dep…