A Composable Evaluation System for Reproducible Omni-Modal Foundation Model Evaluation

Hodong Lee, Sanghee Park, Dohoon Ryu +4

Building an omni-modal foundation model means evaluating it across text, image, video, and audio. Excellent evaluation toolkits exist for each modality, but their inference engines…