4 papers
NewtPhys: Do Foundation Models Understand Newtonian Physics?
Sebastian Cavada, Soumava Paul, Tuan-Hung Vu +2
Previous work has evaluated physics reasoning in foundation models using synthetic or semi-synthetic scenes and visual question-answering tasks. However, these benchmarks emphasize…
Training-Free Fine-Grained Semantic Segmentations in Low Data Regimes: A FungiTastic Baseline
Sebastian Cavada, Francesco Pelosin, Lapo Faggi
Fine-grained semantic segmentation requires both precise localization and discrimination between visually similar classes. In FungiTastic, this problem is further complicated by a…
CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solvers
Dimitrios Mallis, Ahmet Serdar Karadeniz, Sebastian Cavada +5
We propose CAD-Assistant, a general-purpose CAD agent for AI-assisted design. Our approach is based on a powerful Vision and Large Language Model (VLLM) as a planner and a tool-aug…
All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
Ashmal Vayani, Dinura Dissanayake, Hasindri Watawana +66
Existing Large Multimodal Models (LMMs) generally focus on only a few regions and languages. As LMMs continue to improve, it is increasingly important to ensure they understand cul…