48 citations · 92 across the 19 of their papers we have counts for
4 papers · 1 filter
LoNLI: An Extensible Framework for Testing Diverse Logical Reasoning Capabilities for NLI
Ishan Tarunesh, Somak Aditya, Monojit Choudhury
Natural Language Inference (NLI) is considered a representative task to test natural language understanding (NLU). In this work, we propose an extensible framework to collectively…
Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance
Karthikeyan K, Aalok Sathe, Somak Aditya +1
Multilingual language models achieve impressive zero-shot accuracies in many languages in complex tasks such as Natural Language Inference (NLI). Examples in NLI (and equivalent co…
Trusting RoBERTa over BERT: Insights from CheckListing the Natural Language Inference Task
Ishan Tarunesh, Somak Aditya, Monojit Choudhury
The recent state-of-the-art natural language understanding (NLU) systems often behave unpredictably, failing on simpler reasoning examples. Despite this, there has been limited foc…
Analyzing the Nuances of Transformers' Polynomial Simplification Abilities
Vishesh Agarwal, Somak Aditya, Navin Goyal
Symbolic Mathematical tasks such as integration often require multiple well-defined steps and understanding of sub-tasks to reach a solution. To understand Transformers' abilities…