most citedBERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT

7 citations · 11 across the 3 of their papers we have counts for

collaborators
Showing eess.ASShow all

2 papers · 1 filter

eess.AS2020★ 4 cited

AGAIN-VC: A One-shot Voice Conversion using Activation Guidance and Adaptive Instance Normalization

Yen-Hao Chen, Da-Yi Wu, Tsung-Han Wu +1

Recently, voice conversion (VC) has been widely studied. Many VC systems use disentangle-based learning techniques to separate the speaker and the linguistic content information fr…

eess.AS2020

Input-independent Attention Weights Are Expressive Enough: A Study of Attention in Self-supervised Audio Transformers

Tsung-Han Wu, Chun-Chen Hsieh, Yen-Hao Chen +2

In this paper, we seek solutions for reducing the computation complexity of transformer-based models for speech representation learning. We evaluate 10 attention algorithms; then,…