BERTwich: Extending BERT's Capabilities to Model Dialectal and Noisy Text

Aarohi Srivastava, David Chiang

Real-world NLP applications often deal with nonstandard text (e.g., dialectal, informal, or misspelled text). However, language models like BERT deteriorate in the face of dialect…