21 citations · 53 across the 23 of their papers we have counts for
3 papers · 1 filter
Effective Context in Transformers: An Analysis of Fragmentation and Tokenization
Amirmehdi Jafari Fesharaki, Mohammadamin Rami, Aslan Tchamkerten
Transformers predict over a representation of a sequence. The same data can be written as bytes, characters, or subword tokens, and these representations may be lossless. Yet, unde…
Approximating Probability Distributions by ReLU Networks
Manuj Mukherjee, Aslan Tchamkerten, Mansoor Yousefi
How many neurons are needed to approximate a target probability distribution using a neural network with a given input distribution and approximation error? This paper examines thi…
Bounds on the Approximation Power of Feedforward Neural Networks
Mohammad Mehrabi, Aslan Tchamkerten, Mansoor I. Yousefi
The approximation power of general feedforward neural networks with piecewise linear activation functions is investigated. First, lower bounds on the size of a network are establis…