111 citations · 295 across the 63 of their papers we have counts for
65 papers
RIFT: Reordered Instruction Following Testbed To Evaluate Instruction Following in Singular Multistep Prompt Structures
Andrew Jaffe, Noah Reicin, Jinho D. Choi
Large Language Models (LLMs) are increasingly relied upon for complex workflows, yet their ability to maintain flow of instructions remains underexplored. Existing benchmarks confl…
TRUST: An LLM-Based Dialogue System for Trauma Understanding and Structured Assessments
Sichang Tu, Abigail Powers, Stephen Doogan +1
Objectives: While Large Language Models (LLMs) have been widely used to assist clinicians and support patients, no existing work has explored dialogue systems for standard diagnost…
Automating PTSD Diagnostics in Clinical Interviews: Leveraging Large Language Models for Trauma Assessments
Sichang Tu, Abigail Powers, Natalie Merrill +4
The shortage of clinical workforce presents significant challenges in mental healthcare, limiting access to formal diagnostics and services. We aim to tackle this shortage by integ…
What is Your Favorite Gender, MLM? Gender Bias Evaluation in Multilingual Masked Language Models
Jeongrok Yu, Seong Ug Kim, Jacob Choi +1
Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks,…
Language-Oriented Communication with Semantic Coding and Knowledge Distillation for Text-to-Image Generation
Hyelin Nam, Jihong Park, Jinho Choi +2
By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a nov…
Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation
Sarah E. Finch, James D. Finch, Jinho D. Choi
Human evaluation has been widely accepted as the standard for evaluating chat-oriented dialogue systems. However, there is a significant variation in previous work regarding who ge…
Aligning Speakers: Evaluating and Visualizing Text-based Diarization Using Efficient Multiple Sequence Alignment (Extended Version)
Chen Gong, Peilin Wu, Jinho D. Choi
This paper presents a novel evaluation approach to text-based speaker diarization (SD), tackling the limitations of traditional metrics that do not account for any contextual infor…
Leveraging Large Language Models for Automated Dialogue Analysis
Sarah E. Finch, Ellie S. Paek, Jinho D. Choi
Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains chall…
Widely Interpretable Semantic Representation: Frameless Meaning Representation for Broader Applicability
Lydia Feng, Gregor Williamson, Han He +1
This paper presents a novel semantic representation, WISeR, that overcomes challenges for Abstract Meaning Representation (AMR). Despite its strengths, AMR is not easily applied to…
Sequential Semantic Generative Communication for Progressive Text-to-Image Generation
Hyelin Nam, Jihong Park, Jinho Choi +1
This paper proposes new framework of communication system leveraging promising generation capabilities of multi-modal generative models. Regarding nowadays smart applications, succ…
Energy-Efficient Downlink Semantic Generative Communication with Text-to-Image Generators
Hyein Lee, Jihong Park, Sooyoung Kim +1
In this paper, we introduce a novel semantic generative communication (SGC) framework, where generative users leverage text-to-image (T2I) generators to create images locally from…
Towards Open-World Product Attribute Mining: A Lightly-Supervised Approach
Liyan Xu, Chenwei Zhang, Xian Li +2
We present a new task setting for attribute mining on e-commerce products, serving as a practical solution to extract open-world attributes without extensive human intervention. Ou…
FCC: Fusing Conversation History and Candidate Provenance for Contextual Response Ranking in Dialogue Systems
Zihao Wang, Eugene Agichtein, Jinho Choi
Response ranking in dialogues plays a crucial role in retrieval-based conversational systems. In a multi-turn dialogue, to capture the gist of a conversation, contextual informatio…
InterviewBot: Real-Time End-to-End Dialogue System to Interview Students for College Admission
Zihao Wang, Nathan Keyes, Terry Crawford +1
We present the InterviewBot that dynamically integrates conversation history and customized topics into a coherent embedding space to conduct 10 mins hybrid-domain (open and closed…
Unleashing the True Potential of Sequence-to-Sequence Models for Sequence Tagging and Structure Parsing
Han He, Jinho D. Choi
Sequence-to-Sequence (S2S) models have achieved remarkable success on various text generation tasks. However, learning complex structures with S2S models remains challenging as ext…
Enabling the Wireless Metaverse via Semantic Multiverse Communication
Jihong Park, Jinho Choi, Seong-Lyun Kim +1
Metaverse over wireless networks is an emerging use case of the sixth generation (6G) wireless systems, posing unprecedented challenges in terms of its multi-modal data transmissio…
Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue Systems
Sarah E. Finch, James D. Finch, Jinho D. Choi
Despite tremendous advancements in dialogue systems, stable evaluation still requires human judgments producing notoriously high-variance metrics due to their inherent subjectivity…
Towards Semantic Communication Protocols: A Probabilistic Logic Perspective
Sejin Seo, Jihong Park, Seung-Woo Ko +3
Classical medium access control (MAC) protocols are interpretable, yet their task-agnostic control signaling messages (CMs) are ill-suited for emerging mission-critical application…
Online Coreference Resolution for Dialogue Processing: Improving Mention-Linking on Real-Time Conversations
Liyan Xu, Jinho D. Choi
This paper suggests a direction of coreference resolution for online decoding on actively generated input such as dialogue, where the model accepts an utterance and its past contex…
Modeling Task Interactions in Document-Level Joint Entity and Relation Extraction
Liyan Xu, Jinho D. Choi
We target on the document-level relation extraction in an end-to-end setting, where the model needs to jointly perform mention extraction, coreference resolution (COREF) and relati…
A Unified Approach to Semantic Information and Communication based on Probabilistic Logic
Jinho Choi, Seng W. Loke, Jihong Park
Traditionally, studies on technical communication (TC) are based on stochastic modeling and manipulation. This is not sufficient for semantic communication (SC) where semantic elem…
A Unified View on Semantic Information and Communication: A Probabilistic Logic Approach
Jinho Choi, Seng W. Loke, Jihong Park
This article aims to provide a unified and technical approach to semantic information, communication, and their interplay through the lens of probabilistic logic. To this end, on t…
Server-Side Local Gradient Averaging and Learning Rate Acceleration for Scalable Split Learning
Shraman Pal, Mansi Uniyal, Jihong Park +5
In recent years, there have been great advances in the field of decentralized learning with private data. Federated learning (FL) and split learning (SL) are two spearheads possess…
NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation
Kaustubh D. Dhole, Varun Gangal, Sebastian Gehrmann +122
Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained…