activity
20222025
most citedPaLM: Scaling Language Modeling with Pathways

2.1k citations · 4.3k across the 10 of their papers we have counts for

collaborators
Showing cs.CLShow all

6 papers · 1 filter

cs.CL2024

Naive Bayes-based Context Extension for Large Language Models

Jianlin Su, Murtadha Ahmed, Wenbo +3

Large Language Models (LLMs) have shown promising in-context learning abilities. However, conventional In-Context Learning (ICL) approaches are often impeded by length limitations…

cs.CL2024

Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks

R. Patrick Xian, Alex J. Lee, Satvik Lolla +4

The increasing depth of parametric domain knowledge in large language models (LLMs) is fueling their rapid deployment in real-world applications. Understanding model vulnerabilitie…

cs.CL2023

Frontier Language Models are not Robust to Adversarial Arithmetic, or "What do I need to say so you agree 2+2=5?

C. Daniel Freeman, Laura Culp, Aaron Parisi +27

We introduce and study the problem of adversarial arithmetic, which provides a simple yet challenging testbed for language model alignment. This problem is comprised of arithmetic…

cs.CL2023★ 168 cited

PaLM 2 Technical Report

Rohan Anil, Andrew M. Dai, Orhan Firat +125

We introduce PaLM 2, a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM. PaLM 2 i…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.CL2022★ 2.1k cited

PaLM: Scaling Language Modeling with Pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin +64

Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning, which drastically reduces the number of…