An Information-theoretic Multi-task Representation Learning Framework for Natural Language Understanding

Dou Hu, Lingwei Wei, Wei Zhou +1

This paper proposes a new principled multi-task representation learning framework (InfoMTL) to extract noise-invariant sufficient representations for all tasks. It ensures sufficie…