17 citations · 33 across the 12 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models
Karolina Stańczak, Edoardo Ponti, Lucas Torroba Hennigen +2
The success of multilingual pre-trained models is underpinned by their ability to learn representations shared by multiple languages even in absence of any explicit supervision. Ho…
cs.LG2022★ 17 cited
Combining Modular Skills in Multitask Learning
Edoardo M. Ponti, Alessandro Sordoni, Yoshua Bengio +1
A modular design encourages neural models to disentangle and recombine different facets of knowledge to generalise more systematically to new tasks. In this work, we assume that ea…