most citedMM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

11 citations · 16 across the 7 of their papers we have counts for

collaborators
Showing cs.CLShow all

2 papers · 1 filter

cs.CL2025

Synthetic bootstrapped pretraining

Zitong Yang, Aonan Zhang, Hong Liu +4

We introduce Synthetic Bootstrapped Pretraining (SBP), a language model (LM) pretraining procedure that first learns a model of relations between documents from the pretraining dat…

cs.CL2024

Recurrent Drafter for Fast Speculative Decoding in Large Language Models

Yunfei Cheng, Aonan Zhang, Xuanyu Zhang +2

We present Recurrent Drafter (ReDrafter), an advanced speculative decoding approach that achieves state-of-the-art speedup for large language models (LLMs) inference. The performan…