1 citations · 3 across the 9 of their papers we have counts for
4 papers · 2 filters
Contrastive Learning Using Graph Embeddings for Domain Adaptation of Language Models in the Process Industry
Anastasia Zhukova, Jonas Lührs, Christian E. Lobmüller +1
Recent trends in NLP utilize knowledge graphs (KGs) to enhance pretrained language models by incorporating additional knowledge from the graph structures to learn domain-specific t…
What's in the News? Towards Identification of Bias by Commission, Omission, and Source Selection (COSS)
Anastasia Zhukova, Terry Ruas, Felix Hamborg +2
In a world overwhelmed with news, determining which information comes from reliable sources or how neutral is the reported information in the news articles poses a challenge to new…
Link Prediction for Event Logs in the Process Industry
Anastasia Zhukova, Thomas Walton, Christian E. Lobmüller +1
In the era of graph-based retrieval-augmented generation (RAG), link prediction is a significant preprocessing step for improving the quality of fragmented or incomplete domain-spe…
Efficient Domain-adaptive Continual Pretraining for the Process Industry in the German Language
Anastasia Zhukova, Christian E. Matt, Bela Gipp
Domain-adaptive continual pretraining (DAPT) is a state-of-the-art technique that further trains a language model (LM) on its pretraining task, e.g., masked language modeling (MLM)…