73 citations · 82 across the 4 of their papers we have counts for
4 papers
Next-Latent Prediction Transformers Learn Compact World Models
Jayden Teoh, Manan Tomar, Kwangjun Ahn +7
Transformers replace recurrence with a memory that grows with sequence length and self-attention that enables ad-hoc lookups over past tokens. Consequently, they lack an inherent i…
Position Paper: Agent AI Towards a Holistic Intelligence
Qiuyuan Huang, Naoki Wake, Bidipta Sarkar +13
Recent advancements in large foundation models have remarkably enhanced our understanding of sensory information in open-world environments. In leveraging the power of foundation m…
Parallel Online Learning
Daniel Hsu, Nikos Karampatziakis, John Langford +1
In this work we study parallelization of online learning, a core primitive in machine learning. In a parallel environment all known approaches for parallel online learning lead to…
Search-based Structured Prediction
Hal Daumé, John Langford, Daniel Marcu
We present Searn, an algorithm for integrating search and learning to solve complex structured prediction problems such as those that occur in natural language, speech, computation…