5 papers
Toward Generalized Cross-Lingual Hateful Language Detection with Web-Scale Data and Ensemble LLM Annotations
Dang H. Dang, Jelena Mitrovi, Michael Granitzer
We study whether large-scale unlabelled web data and LLM-based synthetic annotations can improve multilingual hate speech detection. Starting from texts crawled via OpenWebSearch.e…
Robust Generalizable Heterogeneous Legal Link Prediction
Lorenz Wendlinger, Simon Alexander Nonn, Abdullah Al Zubaer +1
Recent work has applied link prediction to large heterogeneous legal citation networks \new{with rich meta-features}. We find that this approach can be improved by including edge d…
Krony-PT: GPT2 compressed with Kronecker Products
Mohamed Ayoub Ben Ayad, Jelena Mitrovic, Michael Granitzer
We introduce Krony-PT, a compression technique for GPT-2 based on Kronecker products. We specifically target the feed-forward weights of each transformer block, and systematically…
On the Suitability of pre-trained foundational LLMs for Analysis in German Legal Education
Lorenz Wendlinger, Christian Braun, Abdullah Al Zubaer +4
We show that current open-source foundational LLMs possess instruction capability and German legal background knowledge that is sufficient for some legal analysis in an educational…
Enhancing Rhetorical Figure Annotation: An Ontology-Based Web Application with RAG Integration
Ramona Kühn, Jelena MitroviÄ, Michael Granitzer
Rhetorical figures play an important role in our communication. They are used to convey subtle, implicit meaning, or to emphasize statements. We notice them in hate speech, fake ne…