8 citations · 19 across the 21 of their papers we have counts for
6 papers · 1 filter
Eye, Robot: Learning Expressive Gaze Dynamics via a VLM-Guided Transformer-VAE
Yuhang Hu, Junlin Lyu, Yuan Fang +6
Gaze coordinates attention in human interaction through coupled eye, head, and eyelid motion. A humanoid robot must choose where to look while generating a suitable movement toward…
The Smart Buildings Challenge: Learning Foundation Models for Real-World Optimization at Scale
Judah Goldfeder, Ayush Rai, Philippe M. Wyder +11
Buildings cause nearly 40\% of carbon emissions in the US. Of total building emissions, HVAC systems are responsible for approximately 40-60\% and account for 15\% of global energy…
Physics-based Sphere Packing for Lagrangian Mesh Morphing
Jiong Lin, Hod Lipson
This paper studies tetrahedral meshes as the body representation for differentiable simulation and computational design. Fixed-connectivity meshes degrade under large morphs, while…
Mirage Probes: How Vision Models Fake Visual Understanding
Daniel Ben-Levi, Judah Goldfeder, Weiliang Zhao +5
Vision-language models (VLMs) can answer image-based questions confidently, and often correctly, even when no image is provided. This mirage behavior inflates benchmark scores with…
Evidence of an Emergent "Self" in Continual Robot Learning
Adidev Jhunjhunwala, Judah Goldfeder, Hod Lipson
A key challenge to understanding self-awareness has been a principled way of quantifying whether an intelligent system has a concept of a "self", and if so how to differentiate the…
Beyond Cropping and Rotation: Automated Evolution of Powerful Task-Specific Augmentations with Generative Models
Judah Goldfeder, Shreyes Kaliyur, Vaibhav Sourirajan +5
Data augmentation has long been a cornerstone for reducing overfitting in vision models, with methods like AutoAugment automating the design of task-specific augmentations. Recent…