activity
19992024
most citedLookahead Optimizer: k steps forward, 1 step back

372 citations · 443 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2024★ 3 cited

Decomposed Prompting to Answer Questions on a Course Discussion Board

Brandon Jaipersaud, Paul Zhang, Jimmy Ba +3

We propose and evaluate a question-answering system that uses decomposed prompting to classify and answer student questions on a course discussion board. Our system uses a large la…

cs.CL2023★ 11 cited

Boosted Prompt Ensembles for Large Language Models

Silviu Pitis, Michael R. Zhang, Andrew Wang +1

Methods such as chain-of-thought prompting and self-consistency have pushed the frontier of language model reasoning performance with no additional training. To further improve per…

cs.LG2022★ 3 cited

Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curve

Juhan Bae, Michael R. Zhang, Michael Ruan +4

Variational autoencoders (VAEs) are powerful tools for learning latent representations of data used in a wide range of applications. In practice, VAEs usually require multiple trai…

cs.MA2020

Objective Social Choice: Using Auxiliary Information to Improve Voting Outcomes

Silviu Pitis, Michael R. Zhang

How should one combine noisy information from diverse sources to make an inference about an objective ground truth? This frequently recurring, normative question lies at the core o…

cs.LG2019★ 372 cited

Lookahead Optimizer: k steps forward, 1 step back

Michael R. Zhang, James Lucas, Geoffrey Hinton +1

The vast majority of successful deep neural networks are trained using variants of stochastic gradient descent (SGD) algorithms. Recent attempts to improve SGD can be broadly categ…

physics.bio-ph1999★ 54 cited

Super-paramagnetic clustering of yeast gene expression profiles

G. Getz, E. Levine, E. Domany +1

High-density DNA arrays, used to monitor gene expression at a genomic scale, have produced vast amounts of information which require the development of efficient computational meth…