78 citations · 102 across the 15 of their papers we have counts for
4 papers · 2 filters
Morphosyntactic probing of multilingual BERT models
Judit Acs, Endre Hamerlik, Roy Schwartz +2
We introduce an extensive dataset for multilingual probing of morphological information in language models (247 tasks across 42 languages from 10 families), each consisting of a se…
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings
Daniel Rotem, Michael Hassid, Jonathan Mamou +1
Adaptive inference is a simple method for reducing inference costs. The method works by maintaining multiple classifiers of different capacities, and allocating resources to each t…
Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research
Ji-Ung Lee, Haritz Puerto, Betty van Aken +8
Many recent improvements in NLP stem from the development and use of large pre-trained language models (PLMs) with billions of parameters. Large model sizes makes computational cos…
Fighting Bias with Bias: Promoting Model Robustness by Amplifying Dataset Biases
Yuval Reif, Roy Schwartz
NLP models often rely on superficial cues known as dataset biases to achieve impressive performance, and can fail on examples where these biases do not hold. Recent work sought to…