4 papers
RECALL-MM: A Multimodal Dataset of Consumer Product Recalls for Risk Analysis using Computational Methods and Large Language Models
Diana Bolanos, Mohammadmehdi Ataei, Daniele Grandi +1
Product recalls provide valuable insights into potential risks and hazards within the engineering design process, yet their full potential remains underutilized. In this study, we…
DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentation
Anna C. Doris, Daniele Grandi, Ryan Tomich +4
This research introduces DesignQA, a novel benchmark aimed at evaluating the proficiency of multimodal large language models (MLLMs) in comprehending and applying engineering requi…
MSEval: A Dataset for Material Selection in Conceptual Design to Evaluate Algorithmic Models
Yash Patawari Jain, Daniele Grandi, Allin Groom +2
Material selection plays a pivotal role in many industries, from manufacturing to construction. Material selection is usually carried out after several cycles of conceptual design,…
Evaluating Large Language Models for Material Selection
Daniele Grandi, Yash Patawari Jain, Allin Groom +2
Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final…