129 citations · 717 across the 46 of their papers we have counts for
24 papers · 1 filter
Explaining Math Word Problem Solvers
Abby Newcomb, Jugal Kalita
Automated math word problem solvers based on neural networks have successfully managed to obtain 70-80\% accuracy in solving arithmetic word problems. However, it has been shown th…
Enhancing Translation for Indigenous Languages: Experiments with Multilingual Models
Atnafu Lambebo Tonja, Hellina Hailu Nigatu, Olga Kolesnikova +3
This paper describes CIC NLP's submission to the AmericasNLP 2023 Shared Task on machine translation systems for indigenous languages of the Americas. We present the system descrip…
Abstractive Text Summarization Using the BRIO Training Paradigm
Khang Nhut Lam, Thieu Gia Doan, Khang Thua Pham +1
Summary sentences produced by abstractive summarization models may be coherent and comprehensive, but they lack control and rely heavily on reference summaries. The BRIO training p…
CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT
Dan DeGenaro, Jugal Kalita
Large language models having hundreds of millions, and even billions, of parameters have performed extremely well on a variety of natural language processing (NLP) tasks. Their wid…
Automatically Creating a Large Number of New Bilingual Dictionaries
Khang Nhut Lam, Feras Al Tarouti, Jugal Kalita
This paper proposes approaches to automatically create a large number of new bilingual dictionaries for low-resource languages, especially resource-poor and endangered languages, f…
Creating Lexical Resources for Endangered Languages
Khang Nhut Lam, Feras Al Tarouti, Jugal Kalita
This paper examines approaches to generate lexical resources for endangered languages. Our algorithms construct bilingual dictionaries and multilingual thesauruses using public Wor…
Automatically constructing Wordnet synsets
Khang Nhut Lam, Feras Al Tarouti, Jugal Kalita
Manually constructing a Wordnet is a difficult task, needing years of experts' time. As a first step to automatically construct full Wordnets, we propose approaches to generate Wor…
Creating Reverse Bilingual Dictionaries
Khang Nhut Lam, Jugal Kalita
Bilingual dictionaries are expensive resources and not many are available when one of the languages is resource-poor. In this paper, we propose algorithms for creation of new rever…
Phrase translation using a bilingual dictionary and n-gram data: A case study from Vietnamese to English
Khang Nhut Lam, Feras Al Tarouti, Jugal Kalita
Past approaches to translate a phrase in a language L1 to a language L2 using a dictionary-based approach require grammar rules to restructure initial translations. This paper intr…
Using Random Perturbations to Mitigate Adversarial Attacks on Sentiment Analysis Models
Abigail Swenor, Jugal Kalita
Attacks on deep learning models are often difficult to identify and therefore are difficult to protect against. This problem is exacerbated by the use of public datasets that typic…
Language Model Metrics and Procrustes Analysis for Improved Vector Transformation of NLP Embeddings
Thomas Conley, Jugal Kalita
Artificial Neural networks are mathematical models at their core. This truismpresents some fundamental difficulty when networks are tasked with Natural Language Processing. A key p…
Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Text
Kaden Griffith, Jugal Kalita
This paper outlines the use of Transformer networks trained to translate math word problems to equivalent arithmetic expressions in infix, prefix, and postfix notations. We compare…
Multi-task learning for natural language processing in the 2020s: where are we going?
Joseph Worsham, Jugal Kalita
Multi-task learning (MTL) significantly pre-dates the deep learning era, and it has seen a resurgence in the past few years as researchers have been applying MTL to deep learning s…
Abstractive and mixed summarization for long-single documents
Roger Barrull, Jugal Kalita
The lack of diversity in the datasets available for automatic summarization of documents has meant that the vast majority of neural models for automatic summarization have been tra…
Introducing Aspects of Creativity in Automatic Poetry Generation
Brendan Bena, Jugal Kalita
Poetry Generation involves teaching systems to automatically generate text that resembles poetic work. A deep learning system can learn to generate poetry on its own by training on…
Adversarial Analysis of Natural Language Inference Systems
Tiffany Chien, Jugal Kalita
The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most rece…
Solving Arithmetic Word Problems Automatically Using Transformer and Unambiguous Representations
Kaden Griffith, Jugal Kalita
Constructing accurate and automatic solvers of math word problems has proven to be quite challenging. Prior attempts using machine learning have been trained on corpora specific to…
Parallel Attention Mechanisms in Neural Machine Translation
Julian Richard Medina, Jugal Kalita
Recent papers in neural machine translation have proposed the strict use of attention mechanisms over previous standards such as recurrent and convolutional neural networks (RNNs a…
Abstractive Summarization Using Attentive Neural Techniques
Jacob Krantz, Jugal Kalita
In a world of proliferating data, the ability to rapidly summarize text is growing in importance. Automatic summarization of text can be thought of as a sequence to sequence proble…
Hierarchical Text Generation using an Outline
Mehdi Drissi, Olivia Watkins, Jugal Kalita
Many challenges in natural language processing require generating text, including language translation, dialogue generation, and speech recognition. For all of these problems, text…
Exploring Sentence Vector Spaces through Automatic Summarization
Adly Templeton, Jugal Kalita
Given vector representations for individual words, it is necessary to compute vector representations of sentences for many applications in a compositional manner, often using artif…
A Survey of the Usages of Deep Learning in Natural Language Processing
Daniel W. Otter, Julian R. Medina, Jugal K. Kalita
Over the last several years, the field of natural language processing has been propelled forward by an explosion in the use of deep learning models. This survey provides a brief in…
Deep Learning applied to NLP
Marc Moreno Lopez, Jugal Kalita
Convolutional Neural Network (CNNs) are typically associated with Computer Vision. CNNs are responsible for major breakthroughs in Image Classification and are the core of most Com…
Detecting and Extracting Events from Text Documents
Jugal Kalita
Events of various kinds are mentioned and discussed in text documents, whether they are books, news articles, blogs or microblog feeds. The paper starts by giving an overview of ho…