4 citations · 8 across the 4 of their papers we have counts for
4 papers
Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues
Muhammad Dehan Al Kautsar, Saeed Almheiri, Momina Ahsan +13
There is a significant gap in evaluating cultural reasoning in LLMs using conversational datasets that capture culturally rich and dialectal contexts. Most Arabic benchmarks focus…
DeltaScore: Fine-Grained Story Evaluation with Perturbations
Zhuohan Xie, Miao Li, Trevor Cohn +1
Numerous evaluation metrics have been developed for natural language generation tasks, but their effectiveness in evaluating stories is limited as they are not specifically tailore…
The Next Chapter: A Study of Large Language Models in Storytelling
Zhuohan Xie, Trevor Cohn, Jey Han Lau
To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge.…
Exploring Story Generation with Multi-task Objectives in Variational Autoencoders
Zhuohan Xie, Trevor Cohn, Jey Han Lau
GPT-2 has been frequently adapted in story generation models as it provides powerful generative capability. However, it still fails to generate consistent stories and lacks diversi…