3 papers
cs.CL2024
Arena-Lite: Efficient and Reliable Large Language Model Evaluation via Tournament-Based Direct Comparisons
Seonil Son, Ju-Min Oh, Heegon Jin +3
As Large Language Models (LLMs) expand across domains, LLM judges have become essential for systems evaluation. Current benchmarks typically compare system outputs against baseline…
cs.CL2024
Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation
Heegon Jin, Seonil Son, Jemin Park +3
The advent of scalable deep models and large datasets has improved the performance of Neural Machine Translation. Knowledge Distillation (KD) enhances efficiency by transferring kn…
cs.CV2022
Adaptive Attention Link-based Regularization for Vision Transformers
Heegon Jin, Jongwon Choi
Although transformer networks are recently employed in various vision tasks with outperforming performance, extensive training data and a lengthy training time are required to trai…