12 papers
Generative Recursive Reasoning
Junyeob Baek, Mingyu Jo, Minsu Kim +3
How should future neural reasoning systems implement extended computation? Recursive Reasoning Models (RRMs) offer a promising alternative to autoregressive sequence extension by p…
Inference-Time Scaling in Diffusion Models through Iterative Partial Refinement
Taegu Kang, Jaesik Yoon, Sungjin Ahn
Inference-time scaling has emerged as a major approach for improving reasoning capabilities, and has been increasingly applied to diffusion models. However, existing inference-time…
Compositional Monte Carlo Tree Diffusion for Extendable Planning
Jaesik Yoon, Hyeonseo Cho, Sungjin Ahn
Monte Carlo Tree Diffusion (MCTD) integrates diffusion models with structured tree search to enable effective trajectory exploration through stepwise reasoning. However, MCTD remai…
Loopholing Discrete Diffusion: Deterministic Bypass of the Sampling Wall
Mingyu Jo, Jaesik Yoon, Justin Deschenaux +2
Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occu…
CrafterDojo: A Suite of Foundation Models for Building Open-Ended Embodied Agents in Crafter
Junyeong Park, Hyeonseo Cho, Sungjin Ahn
Developing general-purpose embodied agents is a core challenge in AI. Minecraft provides rich complexity and internet-scale data, but its slow speed and engineering overhead make i…
Fast Monte Carlo Tree Diffusion: 100x Speedup via Parallel Sparse Planning
Jaesik Yoon, Hyeonseo Cho, Yoshua Bengio +1
Diffusion models have recently emerged as a powerful approach for trajectory planning. However, their inherently non-sequential nature limits their effectiveness in long-horizon re…
Adaptive Inference-Time Scaling via Cyclic Diffusion Search
Gyubin Lee, Truong Nhat Nguyen Bao, Jaesik Yoon +4
Diffusion models have demonstrated strong generative capabilities across domains ranging from image synthesis to complex reasoning tasks. However, most inference-time scaling metho…
Latent Veracity Inference for Identifying Errors in Stepwise Reasoning
Minsu Kim, Jean-Pierre Falet, Oliver E. Richardson +5
Chain-of-Thought (CoT) reasoning has advanced the capabilities and transparency of language models (LMs); however, reasoning chains can contain inaccurate statements that reduce pe…
Monte Carlo Tree Diffusion for System 2 Planning
Jaesik Yoon, Hyeonseo Cho, Doojin Baek +2
Diffusion models have recently emerged as a powerful tool for planning. However, unlike Monte Carlo Tree Search (MCTS)-whose performance naturally improves with inference-time comp…
MrSteve: Instruction-Following Agents in Minecraft with What-Where-When Memory
Junyeong Park, Junmo Cho, Sungjin Ahn
Significant advances have been made in developing general-purpose embodied AI in environments like Minecraft through the adoption of LLM-augmented hierarchical approaches. While th…
Spatially-Aware Transformer for Embodied Agents
Junmo Cho, Jaesik Yoon, Sungjin Ahn
Episodic memory plays a crucial role in various cognitive processes, such as the ability to mentally recall past events. While cognitive science emphasizes the significance of spat…
Dr. Strategy: Model-Based Generalist Agents with Strategic Dreaming
Hany Hamed, Subin Kim, Dongyeong Kim +2
Model-based reinforcement learning (MBRL) has been a primary approach to ameliorating the sample efficiency issue as well as to make a generalist agent. However, there has not been…