Transformers as Multi-task Learners: Decoupling Features in Hidden Markov Models

Yifan Hao, Chenlu Ye, Chi Han +1

Transformer based models have shown remarkable capabilities in sequence learning across a wide range of tasks, often performing well on specific task by leveraging input-output exa…