Position: Foundation Models Need Digital Twin Representations

Yiqing Shen, Hao Ding, Lalithkumar Seenivasan +2

Current foundation models (FMs) rely on token representations that directly fragment continuous real-world multimodal data into discrete tokens. They limit FMs to learning real-wor…