565 citations · 773 across the 14 of their papers we have counts for
3 papers · 1 filter
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran +74
Evaluation in machine learning is usually informed by past choices, for example which datasets or metrics to use. This standardization enables the comparison on equal footing using…
Why is constrained neural language generation particularly challenging?
Cristina Garbacea, Qiaozhu Mei
Recent advances in deep neural language models combined with the capacity of large scale datasets have accelerated the development of natural language generation systems that produ…
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…