Transforming Hidden States into Binary Semantic Features

Tomáš Musil, David Mareček

Large language models follow a lineage of many NLP applications that were directly inspired by distributional semantics, but do not seem to be closely related to it anymore. In thi…