47 citations · 98 across the 29 of their papers we have counts for
30 papers
Learning Emotion from Motion: Kinetic Multi-Stream Skeleton Modeling with Metadata-Conditioned Weak Label Distributions
Sosuke Suzuki, Yijin Wei, Koichiro Kamide +3
Skeleton-based emotion recognition from body motion remains challenging because emotional expressions are often characterized by subtle dynamic and relational motion cues, and hard…
Understanding Geometric Representations in Self-Supervised Vision Transformers via Subspace Intervention
Weichen Zhou, Yawen Zou, Chunzhi Gu +3
We introduce a controlled subspace intervention framework to investigate how self-supervised Vision Transformers (ViTs) encode dense geometric information. While linear probing is…
A Study on Cognitive Effects of Canvas Size for Augmenting Drawing Skill
Jize Wang, Kazuhisa Nakano, Daiyannan Chen +4
In recent years, the field of generative artificial intelligence, particularly in the domain of image generation, has exerted a profound influence on society. Despite the capabilit…
ECNet: Effective Controllable Text-to-Image Diffusion Models
Sicheng Li, Keqiang Sun, Zhixin Lai +5
The conditional text-to-image diffusion models have garnered significant attention in recent years. However, the precision of these models is often compromised mainly for two reaso…
A Semi-automatic Oriental Ink Painting Framework for Robotic Drawing from 3D Models
Hao Jin, Minghui Lian, Shicheng Qiu +7
Creating visually pleasing stylized ink paintings from 3D models is a challenge in robotic manipulation. We propose a semi-automatic framework that can extract expressive strokes f…
AniFaceDrawing: Anime Portrait Exploration during Your Sketching
Zhengyu Huang, Haoran Xie, Tsukasa Fukusato +1
In this paper, we focus on how artificial intelligence (AI) can be used to assist users in the creation of anime portraits, that is, converting rough sketches into anime portraits…
DualSlide: Global-to-Local Sketching Interface for Slide Content and Layout Design
Jiahao Weng, Xusheng Du, Haoran Xie
Online learning and academic conferences have become pervasive and essential for education and professional development, especially since the onset of pandemics. Academic presentat…
Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fields
Yi He, Haoran Xie, Kazunori Miyata
3D model reconstruction from a single image has achieved great progress with the recent deep generative models. However, the conventional reconstruction approaches with template me…
DiffFaceSketch: High-Fidelity Face Image Synthesis with Sketch-Guided Latent Diffusion Model
Yichen Peng, Chunqi Zhao, Haoran Xie +2
Synthesizing face images from monochrome sketches is one of the most fundamental tasks in the field of image-to-image translation. However, it is still challenging to (1)~make mode…
Interactive Layout Drawing Interface with Shadow Guidance
Jiahao Weng, Haoran Xie
It is difficult to design a visually appealing layout for common users, which takes time even for professional designers. In this paper, we present an interactive layout design sys…
DualSmoke: Sketch-Based Smoke Illustration Design with Two-Stage Generative Model
Haoran Xie, Keisuke Arihara, Syuhei Sato +1
The dynamic effects of smoke are impressive in illustration design, but it is a troublesome and challenging issue for common users to design the smoke effect without domain knowled…
DualMotion: Global-to-Local Casual Motion Design for Character Animations
Yichen Peng, Chunqi Zhao, Haoran Xie +3
Animating 3D characters using motion capture data requires basic expertise and manual labor. To support the creativity of animation design and make it easier for common users, we p…
MagGlove: A Haptic Glove with Movable Magnetic Force for Manipulation Learning
Mikiya Kusunoki, Shogo Yoshida, Haoran Xie
Recently, haptic gloves have been extensively explored for various practical applications, such as manipulation learning. Previous glove devices have different force-driven systems…
Efficient Human-in-the-loop System for Guiding DNNs Attention
Yi He, Xi Yang, Chia-Ming Chang +2
Attention guidance is an approach to addressing dataset bias in deep learning, where the model relies on incorrect features to make decisions. Focusing on image classification task…
Find Your ASMR: A Perceptual Retrieval Interface for Autonomous Sensory Meridian Response Videos
Qi Zhou, Jiahao Weng, Haoran Xie
Autonomous sensory meridian response (ASMR) is a type of video contents designed to help people relax and feel comfortable. Users usually retrieve ASMR contents from various video…
ILoveEye: Eyeliner Makeup Guidance System with Eye Shape Features
Hange Wang, Haoran Xie, Kazunori Miyata
Drawing eyeliner is not an easy task for whom lacks experience in eye makeup. Everyone has a unique pair of eyes, so they need to draw eyeliner in a style that suits their eyes. We…
Sketch-based 3D Shape Modeling from Sparse Point Clouds
Xusheng Du, Yi He, Xi Yang +2
3D modeling based on point clouds is an efficient way to reconstruct and create detailed 3D content. However, the geometric procedure may lose accuracy due to high redundancy and t…
Interactive 3D Character Modeling from 2D Orthogonal Drawings with Annotations
Zhengyu Huang, Haoran Xie, Tsukasa Fukusato
We propose an interactive 3D character modeling approach from orthographic drawings (e.g., front and side views) based on 2D-space annotations. First, the system builds partial cor…
Hierarchical Visual Interface for Lecture Video Retrieval and Summarization
Jiaohao Weng, Chao Zhang, Xi Yang +1
With the emergence of large-scale open online courses and online academic conferences, it has become increasingly feasible and convenient to access online educational resources. Ho…
NaviChoker: Augmenting Pressure Sensation via Pneumatic Actuator
Shogo Yoshida, Haoran Xie, Kazunori Miyata
Many technologies have been developed in recent years to present audiovisual information in new ways, but developing an information presentation interface to convey tactile informa…
xBalloon: Animated Objects with Balloon Plastic Actuator
Haoran Xie, Takuma Torii, Aoshi Chiba +1
Shape-changing interfaces are promising for users to change the physical properties of common objects. However, prevailing approaches of actuation devices require either profession…
SpatialViewer: A Remote Work Sharing Tool that Considers Intimacy Among Workers
Sicheng Li, Yudai Makioka, Kyousuke Kobayashi +2
Due to the influence of the new coronavirus disease (COVID-19), teleworking has been expanding rapidly. Although existing interactive remote working systems are convenient, they do…
SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches
Haoran Xie, Yichen Peng, Hange Wang +1
In this work, we propose an interactive general instruction framework SketchMeHow to guidance the common users to complete the daily tasks in real-time. In contrast to the conventi…
AugLimb: Compact Robotic Limb for Human Augmentation
Zeyu Ding, Shogo Yoshida, Toby Chong +3
This work proposes a compact robotic limb, AugLimb, that can augment our body functions and support the daily activities. AugLimb adopts the double-layer scissor unit for the exten…