Can Foundation Models Watch, Talk and Guide You Step by Step to Make a Cake?

Yuwei Bao, Keunwoo Peter Yu, Yichi Zhang +6

Despite tremendous advances in AI, it remains a significant challenge to develop interactive task guidance systems that can offer situated, personalized guidance and assist humans…