7 citations · 18 across the 50 of their papers we have counts for
9 papers · 2 filters
Evaluating Compressed Memory: Dependence, Utility, and Content Benefit
Minsu Oh, Seunghui Jwa, Chanjun Park +1
Does a language model answer better because its compressed memory contains useful document information? Replacing memory vectors with zeros can lower a trained model's score withou…
Shared Stopping Decisions Change Answers in HQQ Cache Quantization
Seunghui Jwa, Minsu Oh, Chanjun Park +1
Language-model systems batch questions for throughput, but unrelated questions should not change a target's answer when its input and numerical execution are fixed. We study compre…
Recovering Off-Policy Supervision for Speculative Decoding
Jungseob Lee, Chanjun Park, Sugyeong Eo +1
Block drafters for speculative decoding are commonly trained on corpora written by external models, where a single off-policy token invalidates supervision for all subsequent slots…
The Blindness of Document-Level Translation Evaluation
Ahrii Kim, Vilém Zouhar, Chanjun Park +1
Document-level machine translation (MT) evaluation extends segment-level protocols by presenting full documents to annotators, on the assumption that such presentation elicits docu…
Discourse Dependency: A Continuous Criterion for Translation Difficulty
Ahrii Kim, Chanjun Park, Seong-heum Kim
Recent calls for harder machine translation benchmarks have not clarified what difficulty should mean. We argue that one meaningful and currently unmeasured axis is referential rea…
Skill Following: Evaluating Actual Skill Use in Retrieval-Enabled LLM Agents
Seonghyeon Cho, Chanjun Park
Large Language Model (LLM) agents increasingly rely on external skills, yet standard evaluations obscure whether retrieving these skills actually helps. Aggregate metrics often com…
Beyond Consensus: Downward Bias and Role Asymmetry in Multi-Agent LLM Judges for Subjective Evaluation
Minsoo Song, Chanwoo Kim, Sugyeong Eo +1
Multi-Agent Debate (MAD) has been widely adopted to improve LLM-based evaluation by prompting multiple agents to negotiate and reach a consensus. However, for subjective rubric-bas…
Auditing MCQA Benchmarks through Probability Landscapes
Minsoo Song, Chanjun Park
As Large Language Models rapidly advance, performance on standard multiple-choice question answering (MCQA) benchmarks is reaching saturation. While the community has responded by…
LANGSAE EDITING: Improving Multilingual Information Retrieval via Post-hoc Language Identity Removal
Dongjun Kim, Jeongho Yoon, Chanjun Park +1
Dense retrieval in multilingual settings often searches over mixed-language collections, yet multilingual embeddings encode language identity alongside semantics. This language sig…