52 citations · 69 across the 4 of their papers we have counts for
5 papers
Lessons from Digital India for the Right to Internet Access
Kaustubh D. Dhole
With only 65% of Indian houses having access to the Internet, digital India faces a significant Internet divide across gender and city types. Rendering essential services inaccessi…
Automatic Construction of Evaluation Suites for Natural Language Generation Datasets
Simon Mille, Kaustubh D. Dhole, Saad Mahamood +5
Machine learning approaches applied to NLP are often evaluated by summarizing their performance in a single number, for example accuracy. Since most test sets are constructed as an…
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…
Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries
Ashish Shrivastava, Kaustubh Dhole, Abhinav Bhatt +1
Despite end-to-end neural systems making significant progress in the last decade for task-oriented as well as chit-chat based dialogue systems, most dialogue systems rely on hybrid…
Benchmarking BioRelEx for Entity Tagging and Relation Extraction
Abhinav Bhatt, Kaustubh D. Dhole
Extracting relationships and interactions between different biological entities is still an extremely challenging problem but has not received much attention as much as extraction…