activity
20212024
most citedCLIN-X: pre-trained language models and a study on cross-task transfer for concept extraction in the clinical domain

17 citations · 21 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CL2024

Discourse-Aware In-Context Learning for Temporal Expression Normalization

Akash Kumar Gautam, Lukas Lange, Jannik Strötgen

Temporal expression (TE) normalization is a well-studied problem. However, the predominately used rule-based systems are highly restricted to specific settings, and upcoming machin…

cs.CL2024

AnnoCTR: A Dataset for Detecting and Linking Entities, Tactics, and Techniques in Cyber Threat Reports

Lukas Lange, Marc Müller, Ghazaleh Haratinezhad Torbati +4

Monitoring the threat landscape to be aware of actual or potential attacks is of utmost importance to cybersecurity professionals. Information about cyber threats is typically dist…

cs.LG20241 cited

Rehearsal-Free Modular and Compositional Continual Learning for Language Models

Mingyang Wang, Heike Adel, Lukas Lange +2

Continual learning aims at incrementally acquiring new knowledge while not forgetting existing knowledge. To overcome catastrophic forgetting, methods are either rehearsal-based, i…

cs.LG2023

GradSim: Gradient-Based Language Grouping for Effective Multilingual Training

Mingyang Wang, Heike Adel, Lukas Lange +2

Most languages of the world pose low-resource challenges to natural language processing models. With multilingual training, knowledge can be shared among languages. However, not al…

cs.CL20231 cited

TADA: Efficient Task-Agnostic Domain Adaptation for Transformers

Chia-Chien Hung, Lukas Lange, Jannik Strötgen

Intermediate training of pre-trained transformer-based language models on domain-specific data leads to substantial gains for downstream tasks. To increase efficiency and prevent c…

cs.CL20232 cited

SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domains

Koustava Goswami, Lukas Lange, Jun Araki +1

Prompting pre-trained language models leads to promising results across natural language processing tasks but is less effective when applied in low-resource domains, due to the dom…