6 citations · 18 across the 13 of their papers we have counts for
1 paper · 1 filter
Zehua Lai, Lek-Heng Lim, Yucong Liu
We highlight a perhaps important but hitherto unobserved insight: The attention module in a transformer is a smoothed cubic spline. Viewed in this manner, this mysterious but criti…