2 citations · 4 across the 5 of their papers we have counts for
3 papers · 1 filter
Neural Attention Memory
Hyoungwook Nam, Seung Byum Seo
We propose a novel perspective of the attention mechanism by reinventing it as a memory architecture for neural networks, namely Neural Attention Memory (NAM). NAM is a memory stru…
Neural Sequence-to-grid Module for Learning Symbolic Rules
Segwang Kim, Hyoungwook Nam, Joonyoung Kim +1
Logical reasoning tasks over symbols, such as learning arithmetic operations and computer program evaluations, have become challenges to deep learning. In particular, even state-of…
I-BERT: Inductive Generalization of Transformer to Arbitrary Context Lengths
Hyoungwook Nam, Seung Byum Seo, Vikram Sharma Mailthody +2
Self-attention has emerged as a vital component of state-of-the-art sequence-to-sequence models for natural language processing in recent years, brought to the forefront by pre-tra…