6 papers
OrchestrXR: A Multi-Agent System for Idea-to-Prototype XR Study Authoring
Shuqi Liao, Chenfei Zhu, Karthik Ramani +1
Extended Reality (XR) has become an important interaction paradigm in Human-Computer Interaction (HCI). XR studies are used to investigate interaction, perception, and user behavio…
Towards Natural Language Environment: Understanding Seamless Natural-Language-Based Human-Multi-Robot Interactions
Ziyi Liu, Xinyi Wang, Shao-Kang Hsia +5
As multiple robots are expected to coexist in future households, natural language is increasingly envisioned as a primary medium for human-robot and robot-robot communication. This…
SketchConcept: Sketching-based Concept Recomposition for Product Design using Generative AI
Runlin Duan, Chenfei Zhu, Yuzhao Chen +4
Conceptual product design requires designers to explore the design space of visual and functional concepts simultaneously. Sketching has long been adopted to empower concept explor…
Canvas3D: Empowering Precise Spatial Control for Image Generation with Constraints from a 3D Virtual Canvas
Runlin Duan, Yuzhao Chen, Rahul Jain +3
Generative AI (GenAI) has significantly advanced the ease and flexibility of image creation. However, it remains a challenge to precisely control spatial compositions, including ob…
DesignFromX: Empowering Consumer-Driven Design Space Exploration through Feature Composition of Referenced Products
Runlin Duan, Chenfei Zhu, Yuzhao Chen +3
Industrial products are designed to satisfy the needs of consumers. The rise of generative artificial intelligence (GenAI) enables consumers to easily modify a product by prompting…
GesPrompt: Leveraging Co-Speech Gestures to Augment LLM-Based Interaction in Virtual Reality
Xiyun Hu, Dizhi Ma, Fengming He +5
Large Language Model (LLM)-based copilots have shown great potential in Extended Reality (XR) applications. However, the user faces challenges when describing the 3D environments t…