activity
20172026
most citedPhi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

163 citations · 375 across the 36 of their papers we have counts for

collaborators
Showing 2021 · cs.LGShow all

5 papers · 2 filters

cs.LG2021

Machine Learning for Mechanical Ventilation Control (Extended Abstract)

Daniel Suo, Naman Agarwal, Wenhan Xia +12

Mechanical ventilation is one of the most widely used therapies in the ICU. However, despite broad application from anaesthesia to COVID-related life support, many injurious challe…

cs.LG2021

Anti-Concentrated Confidence Bonuses for Scalable Exploration

Jordan T. Ash, Cyril Zhang, Surbhi Goel +2

Intrinsic rewards play a central role in handling the exploration-exploitation trade-off when designing sequential decision-making algorithms, in both foundational theory and state…

cs.LG2021★ 15 cited

Inductive Biases and Variable Creation in Self-Attention Mechanisms

Benjamin L. Edelman, Surbhi Goel, Sham Kakade +1

Self-attention, an architectural motif designed to model long-range interactions in sequential data, has driven numerous recent breakthroughs in natural language processing and bey…

cs.LG2021★ 2 cited

Acceleration via Fractal Learning Rate Schedules

Naman Agarwal, Surbhi Goel, Cyril Zhang

In practical applications of iterative first-order optimization, the learning rate schedule remains notoriously difficult to understand and expensive to tune. We demonstrate the pr…

cs.LG2021★ 4 cited

Machine Learning for Mechanical Ventilation Control

Daniel Suo, Naman Agarwal, Wenhan Xia +12

We consider the problem of controlling an invasive mechanical ventilator for pressure-controlled ventilation: a controller must let air in and out of a sedated patient's lungs acco…