5 papers
Towards an AI Musician: Synthesizing Sheet Music Problems for Musical Reasoning
Zhilin Wang, Zhe Yang, Yun Luo +8
Enhancing the ability of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) to interpret sheet music is a crucial step toward building AI musicians. However,…
SEE: Continual Fine-tuning with Sequential Ensemble of Experts
Zhilin Wang, Yafu Li, Xiaoye Qu +1
Continual fine-tuning of large language models (LLMs) suffers from catastrophic forgetting. Rehearsal-based methods mitigate this problem by retaining a small set of old data. Neve…
Lost in Literalism: How Supervised Training Shapes Translationese in LLMs
Yafu Li, Ronghao Zhang, Zhilin Wang +5
Large language models (LLMs) have achieved remarkable success in machine translation, demonstrating impressive performance across diverse languages. However, translationese, charac…
Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasing
Zhilin Wang, Yafu Li, Jianhao Yan +2
Dynamical systems theory provides a framework for analyzing iterative processes and evolution over time. Within such systems, repetitive transformations can lead to stable configur…
From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning
Yafu Li, Zhilin Wang, Tingchen Fu +3
Scaling data and model size has been proven effective for boosting the performance of large language models. In addition to training-time scaling, recent studies have revealed that…