5 citations · 10 across the 6 of their papers we have counts for
3 papers · 1 filter
Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023
Daoji Huang, Otmar Hilliges, Luc Van Gool +1
We present Palm, a solution to the Long-Term Action Anticipation (LTA) task utilizing vision-language and large language models. Given an input video with annotated action periods,…
EFE: End-to-end Frame-to-Gaze Estimation
Haldun Balim, Seonwook Park, Xi Wang +2
Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as…
Summarize the Past to Predict the Future: Natural Language Descriptions of Context Boost Multimodal Object Interaction Anticipation
Razvan-George Pasca, Alexey Gavryushin, Muhammad Hamza +5
We study object interaction anticipation in egocentric videos. This task requires an understanding of the spatio-temporal context formed by past actions on objects, coined action c…