activity
20232026
most citedMultimodal Web Navigation with Instruction-Finetuned Foundation Models

6 citations · 8 across the 8 of their papers we have counts for

collaborators

9 papers

cs.AI2026

ResidencyRL: Reinforcement Learning in Simulated Clinical Environments

Valentin Liévin, Samuel Schmidgall, Tim Strother +32

In medical education, physicians convert academic knowledge into clinical expertise through residency: years of training across thousands of encounters, with diverse sources of fee…

cs.LG2026

Affordances Enable Partial World Modeling with LLMs

Khimya Khetarpal, Gheorghe Comanici, Jonathan Richens +5

Full models of the world require complex knowledge of immense detail. While pre-trained large models have been hypothesized to contain similar knowledge due to extensive pre-traini…

cs.LG2025

Multi-Agent Reinforcement Learning for Sample-Efficient Deep Neural Network Mapping

Srivatsan Krishnan, Jason Jabbour, Dan Zhang +4

Mapping deep neural networks (DNNs) to hardware is critical for optimizing latency, energy consumption, and resource utilization, making it a cornerstone of high-performance accele…

cs.LG2025

A2Perf: Real-World Autonomous Agents Benchmark

Ikechukwu Uchendu, Jason Jabbour, Korneel Van den Berghe +15

Autonomous agents and systems cover a number of application areas, from robotics and digital assistants to combinatorial optimization, all sharing common, unresolved research chall…

cs.LG2024

Improving Dynamic Object Interactions in Text-to-Video Generation with AI Feedback

Hiroki Furuta, Heiga Zen, Dale Schuurmans +4

Large text-to-video models hold immense potential for a wide range of downstream applications. However, they struggle to accurately depict dynamic object interactions, often result…

cs.LG2024

ElasticTok: Adaptive Tokenization for Image and Video

Wilson Yan, Volodymyr Mnih, Aleksandra Faust +3

Efficient video tokenization remains a key bottleneck in learning general purpose vision models that are capable of processing long video sequences. Prevailing approaches are restr…

cs.LG2024

Geometric-Averaged Preference Optimization for Soft Preference Labels

Hiroki Furuta, Kuang-Huei Lee, Shixiang Shane Gu +4

Many algorithms for aligning LLMs with human preferences assume that human preferences are binary and deterministic. However, human preferences can vary across individuals, and the…

cs.LG2023★ 2 cited

Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web

Hiroki Furuta, Yutaka Matsuo, Aleksandra Faust +1

Language model agents (LMA) recently emerged as a promising paradigm on muti-step decision making tasks, often outperforming humans and other reinforcement learning agents. Despite…

cs.LG2023★ 6 cited

Multimodal Web Navigation with Instruction-Finetuned Foundation Models

Hiroki Furuta, Kuang-Huei Lee, Ofir Nachum +4

The progress of autonomous web navigation has been hindered by the dependence on billions of exploratory interactions via online reinforcement learning, and domain-specific model d…