6 papers
Evaluating Design Video Generation: Metrics for Compositional Fidelity
Adrienne Deganutti, Dingning Cao, Jaejung Seol +2
Generative video models are increasingly used in design animation tasks, yet no standardized evaluation framework exists for this domain. Unlike natural video generation, design an…
TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design
Haonan Zhu, Elad Hirsch, Alexandria Minetti +2
Text-to-image models now generate graphic design at production scale, yet their supervision still comes primarily from photo-style preference datasets with a single overall verdict…
Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysis
Haonan Zhu, Adrienne Deganutti, Elad Hirsch +1
SVG generation is typically evaluated by comparing rendered outputs to reference images, which captures visual similarity but not the structural properties that make SVG editable,…
Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
Adrienne Deganutti, Elad Hirsch, Haonan Zhu +2
We introduce GraphicDesignBench (GDB), the first comprehensive benchmark suite designed specifically to evaluate AI models on the full breadth of professional graphic design tasks.…
LICA: Layered Image Composition Annotations for Graphic Design Research
Elad Hirsch, Shubham Yadav, Mohit Garg +1
We introduce LICA (Layered Image Composition Annotations), a large scale dataset of 1,550,244 multi-layer graphic design compositions designed to advance structured understanding a…
Image-aware Evaluation of Generated Medical Reports
Gefen Dawidowicz, Elad Hirsch, Ayellet Tal
The paper proposes a novel evaluation metric for automatic medical report generation from X-ray images, VLScore. It aims to overcome the limitations of existing evaluation methods,…