1 citations · 3 across the 11 of their papers we have counts for
15 papers
Diptych: Scoped, AI-Interpreted Comparison for Reference Listening in Music Production
Chongjun Zhong, Abhinaba Roy, Archishman Ghosh +2
Reference listening is a common strategy in music production, but current comparison tools often obscure a key human judgment: deciding what should be compared. We present Diptych,…
DEFINE: Exemplar-Guided Accent Control for Zero-Shot TTS
Ambuj Mehrish, Abhinaba Roy, Alex Ivanov +2
Zero-shot text-to-speech (TTS) can reproduce an unseen speaker from a short reference recording, but typically entangles speaker identity and accent within the same reference. We i…
nnAudio 2: Overcoming Dynamic Compilation Barriers and Transform Inconsistencies
Abhinaba Roy, Junyi Liang, Dorien Herremans
nnAudio is an open-source audio feature extraction toolbox for deep learning, but its use in current environments is hindered by TorchScript incompatibilities, inverse-transform ed…
MERIT: Learning Disentangled Music Representations for Audio Similarity
Abhinaba Roy, Junyi Liang, Dorien Herremans
Current music similarity models typically compute a single, monolithic score, entangling distinct musical dimensions like melody, rhythm, and timbre. This limits user control and i…
KARMA-MV: A Benchmark for Causal Question Answering on Music Videos
Archishman Ghosh, Abhinaba Roy, Dorien Herremans
While significant progress has been made in Video Question Answering and cross-modal understanding, causal reasoning about how visual dynamics drive musical structure in music vide…
Text2Score: Generating Sheet Music From Textual Prompts
Keshav Bhandari, Sungkyun Chang, Abhinaba Roy +4
Developing text-driven symbolic music generation models remains challenging due to the scarcity of aligned text-music datasets and the unreliability of automated captioning pipelin…
Aligning Generative Music AI with Human Preferences: Methods and Challenges
Dorien Herremans, Abhinaba Roy
Recent advances in generative AI for music have achieved remarkable fidelity and stylistic diversity, yet these systems often fail to align with nuanced human preferences due to th…
SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning
Anuradha Chopra, Abhinaba Roy, Dorien Herremans
Detailed captions that accurately reflect the characteristics of a music piece can enrich music databases and drive forward research in music AI. This paper introduces a multi-task…
Text2midi-InferAlign: Improving Symbolic Music Generation with Inference-Time Alignment
Abhinaba Roy, Geeta Puri, Dorien Herremans
We present Text2midi-InferAlign, a novel technique for improving symbolic music generation at inference time. Our method leverages text-to-audio alignment and music structural alig…
MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection
Tongyu Lu, Charlotta-Marlena Geist, Jan Melechovsky +2
We propose MelodySim, a melody-aware music similarity model and dataset for plagiarism detection. First, we introduce a novel method to construct a dataset focused on melodic simil…
JamendoMaxCaps: A Large Scale Music-caption Dataset with Imputed Metadata
Abhinaba Roy, Renhang Liu, Tongyu Lu +1
We introduce JamendoMaxCaps, a large-scale music-caption dataset featuring over 362,000 freely licensed instrumental tracks from the renowned Jamendo platform. The dataset includes…
Text2midi: Generating Symbolic Music from Captions
Keshav Bhandari, Abhinaba Roy, Kyra Wang +3
This paper introduces text2midi, an end-to-end model to generate MIDI files from textual descriptions. Leveraging the growing popularity of multimodal generative approaches, text2m…
MIRFLEX: Music Information Retrieval Feature Library for Extraction
Anuradha Chopra, Abhinaba Roy, Dorien Herremans
This paper introduces an extendable modular system that compiles a range of music feature extraction models to aid music information retrieval research. The features include musica…
Leveraging LLM Embeddings for Cross Dataset Label Alignment and Zero Shot Music Emotion Prediction
Renhang Liu, Abhinaba Roy, Dorien Herremans
In this work, we present a novel method for music emotion recognition that leverages Large Language Model (LLM) embeddings for label alignment across multiple datasets and zero-sho…
MidiCaps: A large-scale MIDI dataset with text captions
Jan Melechovsky, Abhinaba Roy, Dorien Herremans
Generative models guided by text prompts are increasingly becoming more popular. However, no text-to-MIDI models currently exist due to the lack of a captioned MIDI dataset. This w…