8 papers
Pool-Select-Refine for Allocation-Aware Generative Dataset Distillation
Wenmin Li, Shunsuke Sakai, Zhongkai Zhao +1
Diffusion-based dataset distillation has recently emerged as a promising paradigm for condensing large-scale datasets into compact synthetic sets. By leveraging pretrained generati…
Channel-Free Human Activity Recognition via Inductive-Bias-Aware Fusion Design for Heterogeneous IoT Sensor Environments
Tatsuhito Hasegawa
Human activity recognition (HAR) in Internet of Things (IoT) environments must cope with heterogeneous sensor settings that vary across datasets, devices, body locations, sensing m…
DSeq-JEPA: Discriminative Sequential Joint-Embedding Predictive Architecture
Xiangteng He, Shunsuke Sakai, Shivam Chandhok +5
Recent advances in self-supervised visual representation learning have demonstrated the effectiveness of predictive latent-space objectives for learning transferable features. In p…
Contrastive Learning-Enhanced Trajectory Matching for Small-Scale Dataset Distillation
Wenmin Li, Shunsuke Sakai, Tatsuhito Hasegawa
Deploying machine learning models in resource-constrained environments, such as edge devices or rapid prototyping scenarios, increasingly demands distillation of large datasets int…
Analytical Softmax Temperature Setting from Feature Dimensions for Model- and Domain-Robust Classification
Tatsuhito Hasegawa, Shunsuke Sakai
In deep learning-based classification tasks, the softmax function's temperature parameter critically influences the output distribution and overall performance. This study pres…
Noisy Deep Ensemble: Accelerating Deep Ensemble Learning via Noise Injection
Shunsuke Sakai, Shunsuke Tsuge, Tatsuhito Hasegawa
Neural network ensembles is a simple yet effective approach for enhancing generalization capabilities. The most common method involves independently training multiple neural networ…