41 citations · 63 across the 8 of their papers we have counts for
8 papers
Unifying Block-wise PTQ and Distillation-based QAT for Progressive Quantization toward 2-bit Instruction-Tuned LLMs
Jung Hyun Lee, Seungjae Shin, Vinnam Kim +2
As the rapid scaling of large language models (LLMs) poses significant challenges for deployment on resource-constrained devices, there is growing interest in extremely low-bit qua…
Unknown Domain Inconsistency Minimization for Domain Generalization
Seungjae Shin, HeeSun Bae, Byeonghu Na +2
The objective of domain generalization (DG) is to enhance the transferability of the model learned from a source domain to unobserved domains. To prevent overfitting to a specific…
Dirichlet-based Per-Sample Weighting by Transition Matrix for Noisy Label Learning
HeeSun Bae, Seungjae Shin, Byeonghu Na +1
For learning with noisy labels, the transition matrix, which explicitly models the relation between noisy label distribution and clean label distribution, has been utilized to achi…
Make Prompts Adaptable: Bayesian Modeling for Vision-Language Prompt Learning with Data-Dependent Prior
Youngjae Cho, HeeSun Bae, Seungjae Shin +3
Recent Vision-Language Pretrained (VLP) models have become the backbone for many downstream tasks, but they are utilized as frozen model without learning. Prompt learning is a meth…
Frequency Domain-based Dataset Distillation
Donghyeok Shin, Seungjae Shin, Il-Chul Moon
This paper presents FreD, a novel parameterization method for dataset distillation, which utilizes the frequency domain to distill a small-sized synthetic dataset from a large-size…
ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learning
Hyuck Lee, Seungjae Shin, Heeyoung Kim
Existing semi-supervised learning (SSL) algorithms typically assume class-balanced datasets, although the class distributions of many real-world datasets are imbalanced. In general…
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation
Mingi Ji, Seungjae Shin, Seunghyun Hwang +2
Knowledge distillation is a method of transferring the knowledge from a pretrained complex teacher model to a student model, so a smaller network can replace a large teacher networ…
Counterfactual Fairness with Disentangled Causal Effect Variational Autoencoder
Hyemi Kim, Seungjae Shin, JoonHo Jang +4
The problem of fair classification can be mollified if we develop a method to remove the embedded sensitive information from the classification features. This line of separating th…