7 citations · 10 across the 9 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Reader--Writer Coupling in Transformer MLPs
Giyeong Oh, Sunghee Ahn, Youngjae Yu
A transformer MLP gives each hidden channel two roles: a reader that decides when the channel responds, and a writer that decides what it adds back to the residual stream. Read as…
cs.LG2025
KL Penalty Control via Perturbation for Direct Preference Optimization
Sangkyu Lee, Janghoon Han, Hosung Song +3
Direct Preference Optimization (DPO) demonstrates the advantage of aligning a large language model with human preference using only an offline dataset. However, DPO has the limitat…
cs.LG2024
Aligning Large Language Models by On-Policy Self-Judgment
Sangkyu Lee, Sungdong Kim, Ashkan Yousefpour +3
Existing approaches for aligning large language models with human preferences face a trade-off that requires a separate reward model (RM) for on-policy learning. In this paper, we…