4 citations · 12 across the 9 of their papers we have counts for
6 papers · 1 filter
Learning Advanced Self-Attention for Linear Transformers in the Singular Value Domain
Hyowon Wi, Jeongwhan Choi, Noseong Park
Transformers have demonstrated remarkable performance across diverse domains. The key component of Transformers is self-attention, which learns the relationship between any two tok…
PANDA: Expanded Width-Aware Message Passing Beyond Rewiring
Jeongwhan Choi, Sumin Park, Hyowon Wi +2
Recent research in the field of graph neural network (GNN) has identified a critical issue known as "over-squashing," resulting from the bottleneck phenomenon in graph structures,…
Continuous-time Autoencoders for Regular and Irregular Time Series Imputation
Hyowon Wi, Yehjin Shin, Noseong Park
Time series imputation is one of the most fundamental tasks for time series. Real-world time series datasets are frequently incomplete (or irregular with missing observations), in…
An Attentive Inductive Bias for Sequential Recommendation beyond the Self-Attention
Yehjin Shin, Jeongwhan Choi, Hyowon Wi +1
Sequential recommendation (SR) models based on Transformers have achieved remarkable successes. The self-attention mechanism of Transformers for computer vision and natural languag…
Graph Convolutions Enrich the Self-Attention in Transformers!
Jeongwhan Choi, Hyowon Wi, Jayoung Kim +4
Transformers, renowned for their self-attention mechanism, have achieved state-of-the-art performance across various tasks in natural language processing, computer vision, time-ser…
Long-term Time Series Forecasting based on Decomposition and Neural Ordinary Differential Equations
Seonkyu Lim, Jaehyeon Park, Seojin Kim +5
Long-term time series forecasting (LTSF) is a challenging task that has been investigated in various domains such as finance investment, health care, traffic, and weather forecasti…