Transferring Semantic Knowledge Into Language Encoders

Mohammad Umair, Francis Ferraro

We introduce semantic form mid-tuning, an approach for transferring semantic knowledge from semantic meaning representations into transformer-based language encoders. In mid-tuning…