4 papers · 1 filter
Robust Generalizable Heterogeneous Legal Link Prediction
Lorenz Wendlinger, Simon Alexander Nonn, Abdullah Al Zubaer +1
Recent work has applied link prediction to large heterogeneous legal citation networks \new{with rich meta-features}. We find that this approach can be improved by including edge d…
Krony-PT: GPT2 compressed with Kronecker Products
Mohamed Ayoub Ben Ayad, Jelena Mitrovic, Michael Granitzer
We introduce Krony-PT, a compression technique for GPT-2 based on Kronecker products. We specifically target the feed-forward weights of each transformer block, and systematically…
Towards an Improved Metric for Evaluating Disentangled Representations
Sahib Julka, Yashu Wang, Michael Granitzer
Disentangled representation learning plays a pivotal role in making representations controllable, interpretable and transferable. Despite its significance in the domain, the quest…
DriftGAN: Using historical data for Unsupervised Recurring Drift Detection
Christofer Fellicious, Sahib Julka, Lorenz Wendlinger +1
In real-world applications, input data distributions are rarely static over a period of time, a phenomenon known as concept drift. Such concept drifts degrade the model's predictio…