1 citations · 1 across the 6 of their papers we have counts for
1 paper · 1 filter
Zehua Lai, Lek-Heng Lim, Yucong Liu
We highlight a perhaps important but hitherto unobserved insight: The attention module in a transformer is a smoothed cubic spline. Viewed in this manner, this mysterious but criti…