35 citations · 81 across the 27 of their papers we have counts for
4 papers · 1 filter
Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads
Bowen Li, Taeuk Kim, Reinald Kim Amplayo +1
Transformer-based pre-trained language models (PLMs) have dramatically improved the state of the art in NLP across many tasks. This has led to substantial interest in analyzing the…
IDS at SemEval-2020 Task 10: Does Pre-trained Language Model Know What to Emphasize?
Jaeyoul Shin, Taeuk Kim, Sang-goo Lee
We propose a novel method that enables us to determine words that deserve to be emphasized from written text in visual media, relying only on the information from the self-attentio…
Multilingual Chart-based Constituency Parse Extraction from Pre-trained Language Models
Taeuk Kim, Bowen Li, Sang-goo Lee
As it has been unveiled that pre-trained language models (PLMs) are to some extent capable of recognizing syntactic concepts in natural language, much effort has been made to devel…
Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction
Taeuk Kim, Jihun Choi, Daniel Edmiston +1
With the recent success and popularity of pre-trained language models (LMs) in natural language processing, there has been a rise in efforts to understand their inner workings. In…