Combining pre-trained language models and structured knowledge

Pedro Colon-Hernandez, Catherine Havasi, Jason Alonso +2

In recent years, transformer-based language models have achieved state of the art performance in various NLP benchmarks. These models are able to extract mostly distributional info…