2 citations · 3 across the 9 of their papers we have counts for
9 papers
Introspecting Alignment Shifts Beyond Behaviors Implanted Through Fine-Tuning
Kotaro Yoshida, Laura Gomezjurado Gonzalez, Yukinori Yamamoto +3
Fine-tuning enables a source model to acquire desired capabilities and behaviors in a target domain while retaining much of its general-purpose competence. However, this adaptation…
Generalization Measures under Controlled Covariate Shift: A Regime-Aware Benchmark
Sora Nakai, Youssef Fadhloun, Kacem Mathlouthi +4
Predicting generalization from quantities available before target-test evaluation remains a central challenge in deep learning. The systematic benchmark of Jiang et al. (2020) eval…
How Does Preconditioning Guide Feature Learning in Deep Neural Networks?
Kotaro Yoshida, Atsushi Nitanda
Preconditioning is widely used in machine learning to accelerate convergence on the empirical risk, yet its role on the expected risk remains underexplored. In this work, we invest…
DisTaC: Conditioning Task Vectors via Distillation for Robust Model Merging
Kotaro Yoshida, Yuji Naraki, Takafumi Horie +2
Model merging has emerged as an efficient and flexible paradigm for multi-task learning, with numerous methods being proposed in recent years. However, these state-of-the-art techn…
Robust Invariant Representation Learning by Distribution Extrapolation
Kotaro Yoshida, Konstantinos Slavakis
Invariant risk minimization (IRM) aims to enable out-of-distribution (OOD) generalization in deep learning by learning invariant representations. As IRM poses an inherently challen…
On Fairness of Task Arithmetic: The Role of Task Vectors
Hiroki Naganuma, Kotaro Yoshida, Laura Gomezjurado Gonzalez +3
Model editing techniques, particularly task arithmetic with task vectors, offer an efficient alternative to full fine-tuning by enabling direct parameter updates through simple ari…
Augmenting NER Datasets with LLMs: Towards Automated and Refined Annotation
Yuji Naraki, Ryosuke Yamaki, Yoshikazu Ikeda +4
In the field of Natural Language Processing (NLP), Named Entity Recognition (NER) is recognized as a critical technology, employed across a wide array of applications. Traditional…
Towards Understanding Variants of Invariant Risk Minimization through the Lens of Calibration
Kotaro Yoshida, Hiroki Naganuma
Machine learning models traditionally assume that training and test data are independently and identically distributed. However, in real-world applications, the test distribution o…
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration
Hiroki Naganuma, Ryuichiro Hataya, Kotaro Yoshida +1
In the field of computer vision, fine-tuning pre-trained models has become a prevalent strategy for out-of-distribution (OOD) generalization tasks. Different from most prior work t…