6 papers · 1 filter
Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models
Jungseob Lee, Seongtae Hong, Dongyub Jude Lee +4
Speculative decoding accelerates generation without changing its output, but on vision-language models (VLMs) a self-reinforcing cycle holds it back. Because an autoregressive draf…
Funnel of Thoughts: Efficient Test-Time Scaling via Early Voting and Rollout Pruning
Chanhee Park, Sungbin Han, Jeongho Yoon +2
Large Reasoning Models produce diverse, sometimes inconsistent answers across repeated queries on the same problem, so multi-sample inference is a prerequisite for reliable deploym…
Beyond Penalizing Mistakes: Stabilizing Efficiency Training in Large Reasoning Models via Adaptive Correct-Only Rewards
Jungseob Lee, Seungyoon Lee, Seongtae Hong +3
Training large language models to reason efficiently is a critical challenge. While integrating length-penalizing rewards into Group Relative Policy Optimization (GRPO) aims to red…
Skin-Deep: A Geometric Diagnostic for Alignment Fragility in Large Language Model Representations
Dongyub Jude Lee, Jungseob Lee, Seungyoon Lee +5
Refusal on a safety benchmark does not reveal how stable that behavior will remain after model updates. Benign downstream fine-tuning can weaken refusal, yet behavioral evaluations…
DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models
Jungseob Lee, Seongtae Hong, Seungjun Lee +7
Hybrid reasoning models can answer directly or spend extra tokens on extended thinking. A practical router should choose between these modes for each query, so easy problems avoid…
Revise: A Framework for Revising OCRed text in Practical Information Systems with Data Contamination Strategy
Gyuho Shim, Seongtae Hong, Heuiseok Lim
Recent advances in Large Language Models (LLMs) have significantly improved the field of Document AI, demonstrating remarkable performance on document understanding tasks such as q…