Publications (17)
A Unified Model for Zero-shot Music Source Separation, Transcription and Synthesis
Liwei Lin, Qiuqiang Kong, Junyan Jiang +1
We propose a unified model for three inter-related tasks: 1) to \textit{separate} individual sound sources from a mixed music audio, 2) to \textit{transcribe} each sound source to…
Guided Learning Convolution System for DCASE 2019 Task 4
Liwei Lin, Xiangdong Wang, Hong Liu +1
In this paper, we describe in detail the system we submitted to DCASE2019 task 4: sound event detection (SED) in domestic environments. We employ a convolutional neural network (CN…
Robust Source-Free Domain Adaptation for Medical Image Segmentation based on Curriculum Learning
Ziqi Zhang, Yuexiang Li, Yawen Huang +6
Recent studies have uncovered a new research line, namely source-free domain adaptation, which adapts a model to target domains without using the source data. Such a setting can ad…
Guided multi-branch learning systems for sound event detection with sound separation
Yuxin Huang, Liwei Lin, Shuo Ma +5
In this paper, we describe in detail our systems for DCASE 2020 Task 4. The systems are based on the 1st-place system of DCASE 2019 Task 4, which adopts weakly-supervised framework…
Multi-Branch Learning for Weakly-Labeled Sound Event Detection
Yuxin Huang, Xiangdong Wang, Liwei Lin +2
There are two sub-tasks implied in the weakly-supervised SED: audio tagging and event boundary detection. Current methods which combine multi-task learning with SED requires annota…
Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning
Yixiao Zhang, Yukara Ikemiya, Woosung Choi +7
Recent advances in text-to-music editing, which employ text queries to modify music (e.g.\ by changing its style or adjusting instrumental components), present unique challenges an…
Foundation Models for Music: A Survey
Yinghao Ma, Anders Ãland, Anton Ragni +39
In recent years, foundation models (FMs) such as large language models (LLMs) and latent diffusion models (LDMs) have profoundly impacted diverse sectors, including music. This com…
Versatile Symbolic Music-for-Music Modeling via Function Alignment
Junyan Jiang, Daniel Chin, Liwei Lin +2
Many music AI models learn a map between music content and human-defined labels. However, many annotations, such as chords, can be naturally expressed within the music modality its…
Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based Controls
Liwei Lin, Gus Xia, Yixiao Zhang +1
Controllable music generation plays a vital role in human-AI music co-creation. While Large Language Models (LLMs) have shown promise in generating high-quality music, their focus…
Specialized Decision Surface and Disentangled Feature for Weakly-Supervised Polyphonic Sound Event Detection
Liwei Lin, Xiangdong Wang, Hong Liu +1
In this paper, a special decision surface for the weakly-supervised sound event detection (SED) and a disentangled feature (DF) for the multi-label problem in polyphonic SED are pr…
Guided learning for weakly-labeled semi-supervised sound event detection
Liwei Lin, Xiangdong Wang, Hong Liu +1
We propose a simple but efficient method termed Guided Learning for weakly-labeled semi-supervised sound event detection (SED). There are two sub-targets implied in weakly-labeled…
A Novel Fuzzy Search Approach over Encrypted Data with Improved Accuracy and Efficiency
Jinkun Cao, Jinhao Zhu, Liwei Lin +3
As cloud computing becomes prevalent in recent years, more and more enterprises and individuals outsource their data to cloud servers. To avoid privacy leaks, outsourced data usual…
Content-based Controls For Music Large Language Modeling
Liwei Lin, Gus Xia, Junyan Jiang +1
Recent years have witnessed a rapid growth of large-scale language models in the domain of music audio. Such models enable end-to-end generation of higher-quality music, and some a…
AI-Assisted Hyperspectral Interferometry and Single-Cell Dispersion Imaging
Kamyar Behrouzi, Tanveer Ahmed Siddique, Megan Teng +3
Interferometry techniques are essential for extracting phase information from optical systems enabling precise measurements of dispersion and highly sensitive detection of perturba…
Learning generic feature representation with synthetic data for weakly-supervised sound event detection by inter-frame distance loss
Yuxin Huang, Liwei Lin, Xiangdong Wang +4
Due to the limitation of strong-labeled sound event detection data set, using synthetic data to improve the sound event detection system performance has been a new research focus.…
Physics-governed executable modelling of triboelectric nanogenerators
Hongfa Zhao, Baiqiao Wang, Tiancong Zhao +7
Predictive modelling of triboelectric nanogenerators (TENGs) remains fragmented across analytical theories, finite-geometry solvers and disconnected simulation workflows. These dis…
A Novel Sybil Attack Detection Scheme Based on Edge Computing for Mobile IoT Environment
Manli Yuan, Liwei Lin, Zhengyu Wu +1
Internet of things (IoT) connects all items to the Internet through information-sensing devices to exchange information for intelligent identification and management. Sybil attack…