200 citations · 295 across the 12 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.CL2023★ 6 cited
"According to ...": Prompting Language Models Improves Quoting from Pre-Training Data
Orion Weller, Marc Marone, Nathaniel Weir +3
Large Language Models (LLMs) may hallucinate and generate fake information, despite pre-training on factual data. Inspired by the journalistic device of "according to sources", we…
cs.CL2023★ 200 cited
StarCoder: may the source be with you!
Raymond Li, Loubna Ben Allal, Yangtian Zi +64
The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase…
cs.LG2023★ 5 cited
Data Portraits: Recording Foundation Model Training Data
Marc Marone, Benjamin Van Durme
Foundation models are trained on increasingly immense and opaque datasets. Even while these models are now key in AI system building, it can be difficult to answer the straightforw…