most citedInvestigating Pre-trained Language Models on Cross-Domain Datasets, a Step Closer to General AI

1 citations · 1 across the 2 of their papers we have counts for

collaborators

2 papers

cs.CL2023★ 1 cited

Investigating Pre-trained Language Models on Cross-Domain Datasets, a Step Closer to General AI

Mohamad Ballout, Ulf Krumnack, Gunther Heidemann +1

Pre-trained language models have recently emerged as a powerful tool for fine-tuning a variety of language tasks. Ideally, when models are pre-trained on large amount of data, they…

cs.CL2023

Opening the Black Box: Analyzing Attention Weights and Hidden States in Pre-trained Language Models for Non-language Tasks

Mohamad Ballout, Ulf Krumnack, Gunther Heidemann +1

Investigating deep learning language models has always been a significant research area due to the ``black box" nature of most advanced models. With the recent advancements in pre-…