9 citations · 17 across the 11 of their papers we have counts for
12 papers
Monotonicity-Guided Semantic Alignment for Zero-shot Multispeaker Image-to-Speech Synthesis
Lijun Wang, Yixian Lu, Shogo Okada
Direct image-to-speech (Img2Sp) poses an alignment challenge in mapping visual content to ordered speech sequences, as images permit multiple spoken descriptions and lack monotonic…
Cross-lingual Functional Vectors for Emotion Detection in Large Language Models
Jieying Xue, Phuong Minh Nguyen, Minh Le Nguyen +1
Function vectors (FVs) have recently emerged as a promising mechanism for steering the behavior of large language models (LLMs) by injecting task-specific latent direction represen…
Multimodal Rapport Estimation in Real-World HRI
Akihiro Sakuramoto, Takato Hayashi, Ryo Miyoshi +2
Evaluating interaction quality in real-world HRI is an important challenge. If interaction quality can be estimated reliably, the results can be used to improve dialogue strategies…
Speech Signals Complement LLMs for Predicting Interpersonal Attraction in Speed Dating
Yuriko Kikuchi, Takato Hayashi, Ryusei Kimura +3
Large language models (LLMs) can predict interpersonal attraction from conversation transcripts, but it remains unclear what a speech predictor can add beyond transcript-only LLM p…
XPASS-Vis: A Dataset for Cross-Domain Personalized Image Aesthetic Assessment
Takato Hayashi, Hiroaki Takahara, Candy Olivia Mawalim +4
Personalized image aesthetic assessment (PIAA) seeks to model, at the individual level, the subjective nature of aesthetic judgments toward artworks and photographs. Aesthetic pref…
Technical Report of Nomi Team in the Environmental Sound Deepfake Detection Challenge 2026
Candy Olivia Mawalim, Haotian Zhang, Shogo Okada
This paper presents our work for the ICASSP 2026 Environmental Sound Deepfake Detection (ESDD) Challenge. The challenge is based on the large-scale EnvSDD dataset that consists of…
Investigating Role of Big Five Personality Traits in Audio-Visual Rapport Estimation
Takato Hayashi, Ryusei Kimura, Ryo Ishii +1
Automatic rapport estimation in social interactions is a central component of affective computing. Recent reports have shown that the estimation performance of rapport in initial i…
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan +48
Vision Language Models (VLMs) often struggle with culture-specific knowledge, particularly in languages other than English and in underrepresented cultural contexts. To evaluate th…
Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagement
Marius Funk, Shogo Okada, Elisabeth André
Non-verbal behavior is a central challenge in understanding the dynamics of a conversation and the affective states between interlocutors arising from the interaction. Although psy…
BERP: A Blind Estimator of Room Parameters for Single-Channel Noisy Speech Signals
Lijun Wang, Yixian Lu, Ziyan Gao +4
Room acoustical parameters (RAPs), room geometrical parameters (RGPs) and instantaneous occupancy level are essential metrics for parameterizing the room acoustical characteristics…
Android dialogue system for customer service using prompt-based topic control and compliments generation
Miyama Tamotsu, Okada Shogo
This paper describes a dialogue system developed for the Dialogue Robot Competition 2023 that achieves topic control for trip planning by inserting text into prompts using the Chat…
FedCPC: An Effective Federated Contrastive Learning Method for Privacy Preserving Early-Stage Alzheimer's Speech Detection
Wenqing Wei, Zhengdong Yang, Yuan Gao +4
The early-stage Alzheimer's disease (AD) detection has been considered an important field of medical studies. Like traditional machine learning methods, speech-based automatic dete…