47 citations · 47 across the 8 of their papers we have counts for
8 papers
Prior-Conditioned Gaussian Discriminants for Generalizable AI-generated Image Detection
Shashank Kotyan, Makoto Shing, Yuki Imajuku +2
Diffusion-based generators have made synthetic images ubiquitous, but detectors often fail under simultaneous shifts in generator, prompt/style, and source-domain. We study AI-gene…
DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation
Makoto Shing, Masanori Koyama, Takuya Akiba
End-to-end backpropagation requires storing activations throughout all layers, creating memory bottlenecks that limit model scalability. Existing block-wise training methods offer…
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models
Makoto Shing, Kou Misaki, Han Bao +2
Causal language models have demonstrated remarkable capabilities, but their size poses significant challenges for deployment in resource-constrained environments. Knowledge distill…
Local Curvature Smoothing with Stein's Identity for Efficient Score Matching
Genki Osada, Makoto Shing, Takashi Nishide
The training of score-based diffusion models (SDMs) is based on score matching. The challenge of score matching is that it includes a computationally expensive Jacobian trace. Whil…
Release of Pre-Trained Models for the Japanese Language
Kei Sawada, Tianyu Zhao, Makoto Shing +5
AI democratization aims to create a world in which the average person can utilize AI techniques. To achieve this goal, numerous research institutes have attempted to make their res…
Evolutionary Optimization of Model Merging Recipes
Takuya Akiba, Makoto Shing, Yujin Tang +2
Large language models (LLMs) have become increasingly capable, but their development often requires substantial computational resources. While model merging has emerged as a cost-e…
Focused Prefix Tuning for Controllable Text Generation
Congda Ma, Tianyu Zhao, Makoto Shing +2
In a controllable text generation dataset, there exist unannotated attributes that could provide irrelevant learning signals to models that use it for training and thus degrade the…
Text-Guided Scene Sketch-to-Photo Synthesis
AprilPyone MaungMaung, Makoto Shing, Kentaro Mitsui +2
We propose a method for scene-level sketch-to-photo synthesis with text guidance. Although object-level sketch-to-photo synthesis has been widely studied, whole-scene synthesis is…