1.1k citations · 1.3k across the 94 of their papers we have counts for
17 papers · 1 filter
Rendering-Free Lookahead for Question-Guided Active Vision
Koya Sakamoto, Daichi Azuma, Shuhei Kurita +4
Active robot vision requires controlling the camera to reveal task-relevant information that is hidden from the current viewpoint. For example, determining what is inside a box may…
AutoRef: Harness Optimization for Agentic Multi-Reference Image Generation
Yuta Oshima, Ku Onoda, Yusuke Iwasawa +3
Recent image generation models can take multiple reference images as input and combine them into a new image. However, multi-reference image generation remains challenging: models…
JMed48k: A Multi-Profession Japanese Medical Licensing Benchmark for Vision-Language Model Evaluation
Yue Xun, Junyu Liu, Qian Niu +10
We introduce JMed48k, a multi-profession Japanese healthcare licensing benchmark for evaluating vision-language models. Built from official PDF materials released by the Japanese M…
E3VS-Bench: A Benchmark for Viewpoint-Dependent Active Perception in 3D Gaussian Splatting Scenes
Koya Sakamoto, Taiki Miyanishi, Daichi Azuma +6
Visual search in 3D environments requires embodied agents to actively explore their surroundings and acquire task-relevant evidence. However, existing visual search and embodied AI…
PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Models
Hisayuki Yokomizo, Taiki Miyanishi, Yan Gang +3
Vision-Language Models (VLMs) are increasingly applied to robotic perception and manipulation, yet their ability to infer physical properties required for manipulation remains limi…
Towards High-resolution and Disentangled Reference-based Sketch Colorization
Dingkun Yan, Xinrui Wang, Ru Wang +5
Sketch colorization is a critical task for automating and assisting in the creation of animations and digital illustrations. Previous research identified the primary difficulty as…
Diagnosing Long-Video Quantitative Reasoning in Multimodal LLMs via Enumeration and Counting
Fumihiko Tsuchiya, Taiki Miyanishi, Shunsuke Yasuki +5
Final-answer video QA can show whether a model predicts the right number, but not which instances it counted, when the supporting evidence occurs, or why it failed. We diagnose lon…
WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
Yuta Oshima, Yusuke Iwasawa, Masahiro Suzuki +2
Video world models have attracted significant attention for their ability to produce high-fidelity future visual observations conditioned on past observations and navigation action…
MultiBanana: A Challenging Benchmark for Multi-Reference Text-to-Image Generation
Yuta Oshima, Daiki Miyake, Kohsei Matsutani +4
Recent text-to-image generation models have acquired the ability of multi-reference generation and editing; that is, to inherit the appearance of subjects from multiple reference i…
Unlocking Noise-Resistant Vision: Key Architectural Secrets for Robust Models
Bum Jun Kim, Makoto Kawano, Yusuke Iwasawa +1
While the robustness of vision models is often measured, their dependence on specific architectural design choices is rarely dissected. We investigate why certain vision architectu…
CLIP-like Model as a Foundational Density Ratio Estimator
Fumiya Uchiyama, Rintaro Yanagi, Shohei Taniguchi +5
Density ratio estimation is a core concept in statistical machine learning because it provides a unified mechanism for tasks such as importance weighting, divergence estimation, an…
ColorizeDiffusion v2: Enhancing Reference-based Sketch Colorization Through Separating Utilities
Dingkun Yan, Xinrui Wang, Yusuke Iwasawa +3
Reference-based sketch colorization methods have garnered significant attention due to their potential applications in the animation production industry. However, most existing met…
Image Referenced Sketch Colorization Based on Animation Creation Workflow
Dingkun Yan, Xinrui Wang, Zhuoru Li +4
Sketch colorization plays an important role in animation and digital illustration production tasks. However, existing methods still meet problems in that text-guided methods fail t…
Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Model
Xin Zhang, Jiaxian Guo, Paul Yoo +2
Text-to-image generative models have attracted rising attention for flexible image editing via user-specified descriptions. However, text descriptions alone are not enough to elabo…
Realtime Data-Efficient Portrait Stylization Based On Geometric Alignment
Xinrui Wang, Zhuoru Li, Xiao Zhou +2
Portrait Stylization aims to imbue portrait photos with vivid artistic effects drawn from style examples. Despite the availability of enormous training datasets and large network w…
Robustifying Vision Transformer without Retraining from Scratch by Test-Time Class-Conditional Feature Alignment
Takeshi Kojima, Yutaka Matsuo, Yusuke Iwasawa
Vision Transformer (ViT) is becoming more popular in image processing. Specifically, we investigate the effectiveness of test-time adaptation (TTA) on ViT, a technique that has eme…
Domain Prompt Learning for Efficiently Adapting CLIP to Unseen Domains
Xin Zhang, Shixiang Shane Gu, Yutaka Matsuo +1
Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many dist…