activity
20212023
most citedSUPERB: Speech processing Universal PERformance Benchmark

53 citations · 72 across the 11 of their papers we have counts for

collaborators

12 papers

cs.CV2023

VMCML: Video and Music Matching via Cross-Modality Lifting

Yi-Shan Lee, Wei-Cheng Tseng, Fu-En Wang +1

We propose a content-based system for matching video and background music. The system aims to address the challenges in music recommendation for new users or new music give short-f…

eess.AS2023★ 16 cited

SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks

Kai-Wei Chang, Yu-Kai Wang, Hua Shen +4

Prompt tuning is a technology that tunes a small set of parameters to steer a pre-trained language model (LM) to directly generate the output for downstream tasks. Recently, prompt…

eess.AS2023

Ensemble knowledge distillation of self-supervised speech models

Kuan-Po Huang, Tzu-hsun Feng, Yu-Kuan Fu +5

Distilled self-supervised models have shown competitive performance and efficiency in recent years. However, there is a lack of experience in jointly distilling multiple self-super…

eess.AS2022

DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores

Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee

Mean opinion score (MOS) is a typical subjective evaluation metric for speech synthesis systems. Since collecting MOS is time-consuming, it would be desirable if there are accurate…

cs.CV2022

CLA-NeRF: Category-Level Articulated Neural Radiance Field

Wei-Cheng Tseng, Hung-Ju Liao, Lin Yen-Chen +1

We propose CLA-NeRF -- a Category-Level Articulated Neural Radiance Field that can perform view synthesis, part segmentation, and articulated pose estimation. CLA-NeRF is trained a…

eess.AS2022★ 1 cited

SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks

Kai-Wei Chang, Wei-Cheng Tseng, Shang-Wen Li +1

Speech representations learned from Self-supervised learning (SSL) models can benefit various speech processing tasks. However, utilizing SSL representations usually requires fine-…

cs.LG2022★ 1 cited

Meta-CPR: Generalize to Unseen Large Number of Agents with Communication Pattern Recognition Module

Wei-Cheng Tseng, Wei Wei, Da-Cheng Juan +1

Designing an effective communication mechanism among agents in reinforcement learning has been a challenging task, especially for real-world applications. The number of agents can…

q-bio.QM2021★ 1 cited

Leveraging Sequence Embedding and Convolutional Neural Network for Protein Function Prediction

Wei-Cheng Tseng, Po-Han Chi, Jia-Hua Wu +1

The capability of accurate prediction of protein functions and properties is essential in the biotechnology industry, e.g. drug development and artificial protein synthesis, etc. T…

cs.CR2021

Membership Inference Attacks Against Self-supervised Speech Models

Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee

Recently, adapting the idea of self-supervised learning (SSL) on continuous speech has started gaining attention. SSL models pre-trained on a huge amount of unlabeled audio can gen…

cs.CL2021★ 53 cited

SUPERB: Speech processing Universal PERformance Benchmark

Shu-wen Yang, Po-Han Chi, Yung-Sung Chuang +17

Self-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV). The paradigm pretrains a shared model on large…

eess.AS2021

Utilizing Self-supervised Representations for MOS Prediction

Wei-Cheng Tseng, Chien-yu Huang, Wei-Tsung Kao +2

Speech quality assessment has been a critical issue in speech processing for decades. Existing automatic evaluations usually require clean references or parallel ground truth data,…

cs.LG2021

Toward Robust Long Range Policy Transfer

Wei-Cheng Tseng, Jin-Siang Lin, Yao-Min Feng +1

Humans can master a new task within a few trials by drawing upon skills acquired through prior experience. To mimic this capability, hierarchical models combining primitive policie…