RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Can

Yi-Jen Shih, Puyuan Peng, Haohe Liu +2

Recent Speech Full-Duplex (FDX) models are capable of engaging in naturalistic conversation by listening and speaking at the same time. Building on this foundation, recent architec…