3 citations · 9 across the 7 of their papers we have counts for
8 papers
Prefix Executability: Evaluating Tool-Using Agents Beyond Final Success
Amir H. Rezaeian, Weiyi Sun, Yassine Benajiba +1
Tool-use benchmarks often score agents by final task success, but terminal outcomes can obscure whether the intermediate tool-call trajectory was executable. We propose prefix exec…
Characterizing and Measuring Linguistic Dataset Drift
Tyler A. Chang, Kishaloy Halder, Neha Anna John +4
NLP models often degrade in performance when real world data distributions differ markedly from training data. However, existing dataset drift metrics in NLP have generally not con…
Taxonomy Expansion for Named Entity Recognition
Karthikeyan K, Yogarshi Vyas, Jie Ma +7
Training a Named Entity Recognition (NER) model often involves fixing a taxonomy of entity types. However, requirements evolve and we might need the NER model to recognize addition…
Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11
James Gung, Raphael Shu, Emily Moeng +6
With increasing demand for and adoption of virtual assistants, recent work has investigated ways to accelerate bot schema design through the automatic induction of intents or the i…
Simple Yet Effective Synthetic Dataset Construction for Unsupervised Opinion Summarization
Ming Shen, Jie Ma, Shuai Wang +4
Opinion summarization provides an important solution for summarizing opinions expressed among a large number of reviews. However, generating aspect-specific and general summaries i…
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views
Katerina Margatina, Shuai Wang, Yogarshi Vyas +3
Temporal concept drift refers to the problem of data changing over time. In NLP, that would entail that language (e.g. new expressions, meaning shifts) and factual knowledge (e.g.…
Instruction Tuning for Few-Shot Aspect-Based Sentiment Analysis
Siddharth Varia, Shuai Wang, Kishaloy Halder +7
Aspect-based Sentiment Analysis (ABSA) is a fine-grained sentiment analysis task which involves four elements from user-generated texts: aspect term, aspect category, opinion term,…
Siamese Networks for Semantic Pattern Similarity
Yassine Benajiba, Jin Sun, Yong Zhang +3
Semantic Pattern Similarity is an interesting, though not often encountered NLP task where two sentences are compared not by their specific meaning, but by their more abstract sema…