3 papers
cs.CV2025
From Videos to Indexed Knowledge Graphs -- Framework to Marry Methods for Multimodal Content Analysis and Understanding
Basem Rizk, Joel Walsh, Mark Core +1
Analysis of multi-modal content can be tricky, computationally expensive, and require a significant amount of engineering efforts. Lots of work with pre-trained models on static da…
cs.HC2025
Optimizing SIA Development: A Case Study in User-Centered Design for Estuary, a Multimodal Socially Interactive Agent Framework
Spencer Lin, Miru Jun, Basem Rizk +3
This case study presents our user-centered design model for Socially Intelligent Agent (SIA) development frameworks through our experience developing Estuary, an open source multim…
cs.HC2024
Estuary: A Framework For Building Multimodal Low-Latency Real-Time Socially Interactive Agents
Spencer Lin, Basem Rizk, Miru Jun +4
The rise in capability and ubiquity of generative artificial intelligence (AI) technologies has enabled its application to the field of Socially Interactive Agents (SIAs). Despite…