SOHET: Sequence Of Heterogeneous Events Transformer with Self-Supervised Pre-Training

Kees Jan de Vries, Mustafa Radha, Mathijs de Jong

Many machine learning applications rely on heterogeneous event streams to make predictions, either causally as events arrive or bidirectionally over complete sequences. We propose…