563 citations
- FACE FoundationUS8 papers
- Stanford UniversityUS5 papers
- Cornell UniversityUS4 papers
- Massachusetts Institute of TechnologyUS4 papers
- Allen Institute for Artificial IntelligenceUS3 papers
- Carnegie Mellon UniversityUS3 papers
- Google (United States)US3 papers
- King Fahd University of Petroleum and MineralsSA3 papers
- Sorbonne UniversitéFR3 papers
- Allen InstituteUS2 papers
- Booz Allen Hamilton (United States)US2 papers
- École PolytechniqueFR2 papers
4 papers · 1 filter
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky +8
What are the units of text that we want to model? From bytes to multi-word expressions, text can be analyzed and generated at many granularities. Until recently, most natural langu…
Multitask Prompted Training Enables Zero-Shot Task Generalization
Victor Sanh, Albert Webson, Colin Raffel +38
Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a…
MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluation
Alexandros Karargyris, Renato Umeton, Micah J. Sheller +39
Medical AI has tremendous potential to advance healthcare by supporting the evidence-based practice of medicine, personalizing patient treatment, reducing costs, and improving prov…
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Julia Kreutzer, Isaac Caswell, Lisa Wang +49
With the success of large-scale pre-training and multilingual modeling in Natural Language Processing (NLP), recent years have seen a proliferation of large, web-mined text dataset…