75 citations · 145 across the 12 of their papers we have counts for
3 papers · 1 filter
Constant Memory Attention Block
Leo Feng, Frederick Tung, Hossein Hajimirsadeghi +2
Modern foundation model architectures rely on attention mechanisms to effectively capture context. However, these methods require linear or quadratic memory in terms of the number…
Memory Efficient Neural Processes via Constant Memory Attention Block
Leo Feng, Frederick Tung, Hossein Hajimirsadeghi +2
Neural Processes (NPs) are popular meta-learning methods for efficiently modelling predictive uncertainty. Recent state-of-the-art methods, however, leverage expensive attention me…
Meta Temporal Point Processes
Wonho Bae, Mohamed Osama Ahmed, Frederick Tung +1
A temporal point process (TPP) is a stochastic process where its realization is a sequence of discrete events in time. Recent work in TPPs model the process using a neural network…