12 papers
Evaluating Compositional Approaches for Focus and Sentiment Analysis
Olga Kellert, Muhammad Imran, Nicholas Hill Matlis +2
This paper summarizes the results of evaluating a compositional approach for Focus Analysis (FA) in Linguistics and Sentiment Analysis (SA) in Natural Language Processing (NLP). Wh…
Parsing the Switch: LLM-Based UD Annotation for Complex Code-Switched and Low-Resource Languages
Olga Kellert, Nemika Tyagi, Muhammad Imran +2
Code-switching presents a complex challenge for syntactic analysis, especially in low-resource language settings where annotated data is scarce. While recent work has explored the…
Comparing LLM-generated and human-authored news text using formal syntactic theory
Olga Zamaraeva, Dan Flickinger, Francis Bond +1
This study provides the first comprehensive comparison of New York Times-style text generated by six large language models against real, human-authored NYT writing. The comparison…
Grammar Assistance Using Syntactic Structures (GAUSS)
Olga Zamaraeva, Lorena S. Allegue, Carlos Gómez-Rodríguez +2
Automatic grammar coaching serves an important purpose of advising on standard grammar varieties while not imposing social pressures or reinforcing established social roles. Such s…
Dancing in the syntax forest: fast, accurate and explainable sentiment analysis with SALSA
Carlos Gómez-Rodríguez, Muhammad Imran, David Vilares +2
Sentiment analysis is a key technology for companies and institutions to gauge public opinion on products, services or events. However, for large-scale sentiment analysis to be acc…
The Unlikely Duel: Evaluating Creative Writing in LLMs through a Unique Scenario
Carlos Gómez-Rodríguez, Paul Williams
This is a summary of the paper "A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing", which was published in Findings of EMNLP 2023. We evaluate a range…