48 citations · 81 across the 9 of their papers we have counts for
3 papers · 1 filter
JaxPruner: A concise library for sparsity research
Joo Hyung Lee, Wonpyo Park, Nicole Mitchell +22
This paper introduces JaxPruner, an open-source JAX-based pruning and sparse training library for machine learning research. JaxPruner aims to accelerate research on sparse neural…
GRPE: Relative Positional Encoding for Graph Transformer
Wonpyo Park, Woonggi Chang, Donggeon Lee +2
We propose a novel positional encoding for learning graph on Transformer architecture. Existing approaches either linearize a graph to encode absolute position in the sequence of n…
Regularizing Neural Networks via Stochastic Branch Layers
Wonpyo Park, Paul Hongsuck Seo, Bohyung Han +1
We introduce a novel stochastic regularization technique for deep neural networks, which decomposes a layer into multiple branches with different parameters and merges stochastical…