Semantic Fusion with Fuzzy-Membership Features for Controllable Language Modelling

Yongchao Huang, Hassan Raza

We propose semantic fusion, a lightweight scheme that augments a Transformer language model (LM) with a parallel, fuzzy-membership feature channel that encodes token-level semantic…