4 papers
EgoMem: Lifelong Memory Agent for Full-duplex Omnimodal Models
Yiqun Yao, Naitong Yu, Xiang Li +7
We introduce EgoMem, the first lifelong memory agent tailored for full-duplex models that process real-time omnimodal streams. EgoMem enables real-time models to recognize multiple…
FLM-Audio: Natural Monologues Improves Native Full-Duplex Chatbots via Dual Training
Yiqun Yao, Xiang Li, Xin Jiang +5
Full-duplex dialog models aim to listen and speak simultaneously, delivering rapid responses to dynamic user input. Among different solutions to full-duplexity, a native solution m…
Sketch: A Toolkit for Streamlining LLM Operations
Xin Jiang, Xiang Li, Wenjia Ma +8
Large language models (LLMs) represented by GPT family have achieved remarkable success. The characteristics of LLMs lie in their ability to accommodate a wide range of tasks throu…
Open-domain Implicit Format Control for Large Language Model Generation
Yiqun Yao, Wenjia Ma, Xuezhi Fang +7
Controlling the format of outputs generated by large language models (LLMs) is a critical functionality in various applications. Current methods typically employ constrained decodi…