3 citations · 6 across the 7 of their papers we have counts for
3 papers · 1 filter
Knowledge Acquisition During Pre-training? Large Language Models Learn Better With Auxiliary Views
Joseph Lee, Yidi Huang, Dokyoon Kim +2
Gaps remain in our understanding of how large language models (LLMs) acquire knowledge during pre-training. We find that auxiliary views, conceptual reformulations, are key to this…
Agents' Last Exam
Yiyou Sun, Xinyang Han, Weichen Zhang +355
Recent AI systems have achieved strong results on a wide range of benchmarks, yet these gains have not translated into economically meaningful deployment across many professional d…
Tokenization Tradeoffs in Structured EHR Foundation Models
Lin Lawrence Guo, Santiago Eduardo Arciniegas, Joseph Jihyung Lee +4
Foundation models for structured electronic health records (EHRs) are pretrained on longitudinal sequences of timestamped clinical events to learn adaptable patient representations…