Avoiding Kernel Fixed Points: Computing with ELU and GELU Infinite Networks

Russell Tsuchida, Tim Pearce, Chris van der Heide +2

Analysing and computing with Gaussian processes arising from infinitely wide neural networks has recently seen a resurgence in popularity. Despite this, many explicit covariance fu…