CLMSM: A Multi-Task Learning Framework for Pre-training on Procedural Text

Abhilash Nandy, Manav Nitin Kapadnis, Pawan Goyal +1

In this paper, we propose CLMSM, a domain-specific, continual pre-training framework, that learns from a large set of procedural recipes. CLMSM uses a Multi-Task Learning Framework…