7 papers
AugMask: Training Diffusion Models on Incomplete Tabular Data via Stochastic Augmentation and Masking
Jungkyu Kim, Taeyoung Park, Kibok Lee
Score-based diffusion models have emerged as prominent deep generative models; however, their application to tabular data remains challenging because their backbones assume fully s…
Dataset-Driven Channel Masks in Transformers for Multivariate Time Series
Seunghan Lee, Taeyoung Park, Kibok Lee
Recent advancements in foundation models have been successfully extended to the time series (TS) domain, facilitated by the emergence of large-scale TS datasets. However, previous…
Soft Contrastive Learning for Time Series
Seunghan Lee, Taeyoung Park, Kibok Lee
Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from…
Channel Normalization for Time Series Channel Identification
Seunghan Lee, Taeyoung Park, Kibok Lee
Channel identifiability (CID) refers to the ability to distinguish between individual channels in time series (TS) modeling. The absence of CID often results in producing identical…
To Predict or Not To Predict? Proportionally Masked Autoencoders for Tabular Data Imputation
Jungkyu Kim, Kibok Lee, Taeyoung Park
Masked autoencoders (MAEs) have recently demonstrated effectiveness in tabular data imputation. However, due to the inherent heterogeneity of tabular data, the uniform random maski…
Sequential Order-Robust Mamba for Time Series Forecasting
Seunghan Lee, Juri Hong, Kibok Lee +1
Mamba has recently emerged as a promising alternative to Transformers, offering near-linear complexity in processing sequential data. However, while channels in time series (TS) da…