4 papers
On Emotion-Sensitive Decision Making of Small Language Model Agents
Jiaju Lin, Xingjian Du, Qingyun Wu +2
Small language models (SLM) are increasingly used as interactive decision-making agents, yet most decision-oriented evaluations ignore emotion as a causal factor influencing behavi…
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Bo Peng, Ruichong Zhang, Daniel Goldstein +15
We present RWKV-7 "Goose", a new sequence modeling architecture with constant memory usage and constant inference time per token. Despite being trained on dramatically fewer tokens…
Audio Mamba: Pretrained Audio State Space Model For Audio Tagging
Jiaju Lin, Haoxuan Hu
Audio tagging is an important task of mapping audio samples to their corresponding categories. Recently endeavours that exploit transformer models in this field have achieved great…
ByteComposer: a Human-like Melody Composition Method based on Language Model Agent
Xia Liang, Xingjian Du, Jiaju Lin +3
Large Language Models (LLM) have shown encouraging progress in multimodal understanding and generation tasks. However, how to design a human-aligned and interpretable melody compos…