Can Language Models Learn to Listen?

Evonne Ng, Sanjay Subramanian, Dan Klein +3

We present a framework for generating appropriate facial responses from a listener in dyadic social interactions based on the speaker's words. Given an input transcription of the s…