4 papers
ToolGrad: Efficient Tool-use Dataset Generation with Textual "Gradients"
Zhongyi Zhou, Kohei Uehara, Haoyu Zhang +5
Prior work synthesizes tool-use LLM datasets by first generating a user query, followed by complex tool-use annotations like depth-first search (DFS). This leads to inevitable anno…
MiXR: Harvesting and Recomposing Geometry from Real-World Objects for In-Situ 3D Design
Faraz Faruqi, Demircan Tas, Arthur Caetano +6
Recent developments in 3D generative AI enable users to create bespoke 3D models from text or image prompts. However, these approaches provide limited control over spatial structur…
Vibe Coding XR: Accelerating AI + XR Prototyping with XR Blocks and Gemini
Ruofei Du, Benjamin Hersh, David Li +11
While large language models (LLMs) have accelerated 2D software development through intent-driven "vibe coding", prototyping intelligent Extended Reality (XR) experiences remains a…
XR Blocks: Accelerating Human-centered AI + XR Innovation
David Li, Nels Numan, Xun Qian +17
We are on the cusp where Artificial Intelligence (AI) and Extended Reality (XR) are converging to unlock new paradigms of interactive computing. However, a significant gap exists b…