4 citations · 8 across the 6 of their papers we have counts for
6 papers
Relative Density Ratio Optimization for Stable and Statistically Consistent Model Alignment
Hiroshi Takahashi, Tomoharu Iwata, Atsutoshi Kumagai +4
Aligning language models with human preferences is essential for ensuring their safety and reliability. Although most existing approaches assume specific human preference models su…
Test-time reward-guided alignment of language models by importance sampling on pre-logit space
Sekitoshi Kanai, Tsukasa Yoshida, Hiroshi Takahashi +2
Test-time alignment of large language models (LLMs) attracts attention because fine-tuning of LLMs requires high computational costs. In this paper, we propose a new test-time rewa…
One-vs-the-Rest Loss to Focus on Important Samples in Adversarial Training
Sekitoshi Kanai, Shin'ya Yamaguchi, Masanori Yamada +3
This paper proposes a new loss function for adversarial training. Since adversarial training has difficulties, e.g., necessity of high model capacity, focusing on important data po…
Smoothness Analysis of Adversarial Training
Sekitoshi Kanai, Masanori Yamada, Hiroshi Takahashi +2
Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to op…
Adversarial Training Makes Weight Loss Landscape Sharper in Logistic Regression
Masanori Yamada, Sekitoshi Kanai, Tomoharu Iwata +4
Adversarial training is actively studied for learning robust models against adversarial examples. A recent study finds that adversarially trained models degenerate generalization p…
Constraining Logits by Bounded Function for Adversarial Robustness
Sekitoshi Kanai, Masanori Yamada, Shin'ya Yamaguchi +2
We propose a method for improving adversarial robustness by addition of a new bounded function just before softmax. Recent studies hypothesize that small logits (inputs of softmax)…