30 citations · 59 across the 9 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023★ 3 cited
Can BERT eat RuCoLA? Topological Data Analysis to Explain
Irina Proskurina, Irina Piontkovskaya, Ekaterina Artemova
This paper investigates how Transformer language models (LMs) fine-tuned for acceptability classification capture linguistic features. Our approach uses the best practices of topol…
cs.CL2023★ 7 cited
PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing
Xiaozhe Ren, Pingyi Zhou, Xinfan Meng +14
The scaling of large language models has greatly improved natural language understanding, generation, and reasoning. In this work, we develop a system that trained a trillion-param…