6 papers
AsyncOPD: How Stale Can On-Policy Distillation Be?
Wonjun Kang, Kevin Galim, Seunghyuk Oh +9
On-policy distillation (OPD) trains a student on its own rollouts guided by teacher feedback and is becoming increasingly important for large language model (LLM) post-training. Li…
Open AI in the Wild: Adoption and Adaptation of Open Models on r/LocalLLaMA
Woohyeuk Lee, James Howison, Min Kyung Lee +1
Existing work on AI openness has focused on defining what technical components or release practices qualify a system as "open". However, less is known about how openness is underst…
EfficientRollout: System-Aware Self-Speculative Decoding for RL Rollouts
Minseo Kim, Minjae Lee, Seunghyuk Oh +7
Reinforcement learning (RL) has become a representative post-training paradigm for LLMs, enabling strong reasoning and agentic capabilities. However, rollout generation remains a d…
GenOL: Generating Diverse Examples for Name-only Online Learning
Minhyuk Seo, Seongwon Cho, Minjae Lee +4
Online learning methods often rely on supervised data. However, under data distribution shifts, such as in continual learning (CL), where continuously arriving online data streams…
Transformers in the Dark: Navigating Unknown Search Spaces via Bandit Feedback
Jungtaek Kim, Thomas Zeng, Ziqian Lin +5
Effective problem solving with Large Language Models (LLMs) can be enhanced when they are paired with external search algorithms. By viewing the space of diverse ideas and their fo…
OASIS: Online Sample Selection for Continual Visual Instruction Tuning
Minjae Lee, Minhyuk Seo, Tingyu Qu +2
In continual instruction tuning (CIT) scenarios, where new instruction tuning data continuously arrive in an online streaming manner, training delays from large-scale data signific…