20 citations · 48 across the 20 of their papers we have counts for
20 papers
Relative Density Ratio Optimization for Stable and Statistically Consistent Model Alignment
Hiroshi Takahashi, Tomoharu Iwata, Atsutoshi Kumagai +4
Aligning language models with human preferences is essential for ensuring their safety and reliability. Although most existing approaches assume specific human preference models su…
Test-time reward-guided alignment of language models by importance sampling on pre-logit space
Sekitoshi Kanai, Tsukasa Yoshida, Hiroshi Takahashi +2
Test-time alignment of large language models (LLMs) attracts attention because fine-tuning of LLMs requires high computational costs. In this paper, we propose a new test-time rewa…
Post-pre-training for Modality Alignment in Vision-Language Foundation Models
Shin'ya Yamaguchi, Dewei Feng, Sekitoshi Kanai +2
Contrastive language image pre-training (CLIP) is an essential component of building modern vision-language foundation models. While CLIP demonstrates remarkable zero-shot performa…
Evaluating Time-Series Training Dataset through Lens of Spectrum in Deep State Space Models
Sekitoshi Kanai, Yasutoshi Ida, Kazuki Adachi +3
This study investigates a method to evaluate time-series datasets in terms of the performance of deep neural networks (DNNs) with state space models (deep SSMs) trained on the data…
Adaptive Random Feature Regularization on Fine-tuning Deep Neural Networks
Shin'ya Yamaguchi, Sekitoshi Kanai, Kazuki Adachi +1
While fine-tuning is a de facto standard method for training deep neural networks, it still suffers from overfitting when using small target datasets. Previous methods improve fine…
Adversarial Finetuning with Latent Representation Constraint to Mitigate Accuracy-Robustness Tradeoff
Satoshi Suzuki, Shin'ya Yamaguchi, Shoichiro Takeda +4
This paper addresses the tradeoff between standard accuracy on clean examples and robustness against adversarial examples in deep neural networks (DNNs). Although adversarial train…
Regularizing Neural Networks with Meta-Learning Generative Models
Shin'ya Yamaguchi, Daiki Chijiwa, Sekitoshi Kanai +2
This paper investigates methods for improving generative data augmentation for deep learning. Generative data augmentation leverages the synthetic samples produced by generative mo…
Fast Regularized Discrete Optimal Transport with Group-Sparse Regularizers
Yasutoshi Ida, Sekitoshi Kanai, Kazuki Adachi +2
Regularized discrete optimal transport (OT) is a powerful tool to measure the distance between two discrete distributions that have been constructed from data samples on two differ…
Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks
Kentaro Ohno, Sekitoshi Kanai, Yasutoshi Ida
Gate functions in recurrent models, such as an LSTM and GRU, play a central role in learning various time scales in modeling time series data by using a bounded activation function…
One-vs-the-Rest Loss to Focus on Important Samples in Adversarial Training
Sekitoshi Kanai, Shin'ya Yamaguchi, Masanori Yamada +3
This paper proposes a new loss function for adversarial training. Since adversarial training has difficulties, e.g., necessity of high model capacity, focusing on important data po…
Transfer Learning with Pre-trained Conditional Generative Models
Shin'ya Yamaguchi, Sekitoshi Kanai, Atsutoshi Kumagai +2
Transfer learning is crucial in training deep neural networks on new target tasks. Current transfer learning methods always assume at least one of (i) source and target task label…
F-Drop&Match: GANs with a Dead Zone in the High-Frequency Domain
Shin'ya Yamaguchi, Sekitoshi Kanai
Generative adversarial networks built from deep convolutional neural networks (GANs) lack the ability to exactly replicate the high-frequency components of natural images. To allev…
Smoothness Analysis of Adversarial Training
Sekitoshi Kanai, Masanori Yamada, Hiroshi Takahashi +2
Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to op…
Adversarial Training Makes Weight Loss Landscape Sharper in Logistic Regression
Masanori Yamada, Sekitoshi Kanai, Tomoharu Iwata +4
Adversarial training is actively studied for learning robust models against adversarial examples. A recent study finds that adversarially trained models degenerate generalization p…
Constraining Logits by Bounded Function for Adversarial Robustness
Sekitoshi Kanai, Masanori Yamada, Shin'ya Yamaguchi +2
We propose a method for improving adversarial robustness by addition of a new bounded function just before softmax. Recent studies hypothesize that small logits (inputs of softmax)…
Effective Data Augmentation with Multi-Domain Learning GANs
Shin'ya Yamaguchi, Sekitoshi Kanai, Takeharu Eda
For deep learning applications, the massive data development (e.g., collecting, labeling), which is an essential process in building practical applications, still incurs seriously…
Image Enhanced Rotation Prediction for Self-Supervised Learning
Shin'ya Yamaguchi, Sekitoshi Kanai, Tetsuya Shioda +1
The rotation prediction (Rotation) is a simple pretext-task for self-supervised learning (SSL), where models learn useful representations for target vision tasks by solving pretext…
Absum: Simple Regularization Method for Reducing Structural Sensitivity of Convolutional Neural Networks
Sekitoshi Kanai, Yasutoshi Ida, Yasuhiro Fujiwara +2
We propose Absum, which is a regularization method for improving adversarial robustness of convolutional neural networks (CNNs). Although CNNs can accurately recognize images, rece…
Autoencoding Binary Classifiers for Supervised Anomaly Detection
Yuki Yamanaka, Tomoharu Iwata, Hiroshi Takahashi +2
We propose the Autoencoding Binary Classifiers (ABC), a novel supervised anomaly detector based on the Autoencoder (AE). There are two main approaches in anomaly detection: supervi…
Sigsoftmax: Reanalysis of the Softmax Bottleneck
Sekitoshi Kanai, Yasuhiro Fujiwara, Yuki Yamanaka +1
Softmax is an output activation function for modeling categorical probability distributions in many applications of deep learning. However, a recent study revealed that softmax can…