RoCo-ACE: Rollout-Conditioned Online Distillation for Retention-Aware Knowledge Injection

Yan Hong, Wei Li, Kedong Xiu +6

Knowledge injection updates pretrained MLLMs with new factual or domain-specific knowledge, but fitting full authoritative answers can cause drift in non-updated behavior. Online d…