output
20202026
most citedMultitask Prompted Training Enables Zero-Shot Task Generalization

563 citations

Showing cs.LGShow all

7 papers · 1 filter

cs.LG2025★ 6 cited

AI for Scientific Discovery is a Social Problem

Georgia Channing, Avijit Ghosh

Artificial intelligence (AI) is being increasingly applied to scientific research, but its benefits remain unevenly distributed across different communities and disciplines. While…

cs.LG2024

Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfitting

Mohamed Salim Aissi, Clement Romac, Thomas Carta +5

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly…

cs.LG2024★ 18 cited

Croissant: A Metadata Format for ML-Ready Datasets

Mubashara Akhtar, Omar Benjelloun, Costanza Conforti +28

Data is a critical resource for machine learning (ML), yet working with data remains a key friction point. This paper introduces Croissant, a metadata format for datasets that crea…

cs.LG2023★ 310 cited

Power Hungry Processing: Watts Driving the Cost of AI Deployment?

Alexandra Sasha Luccioni, Yacine Jernite, Emma Strubell

Recent years have seen a surge in the popularity of commercial AI products based on generative, multi-purpose AI systems promising a unified approach to building machine learning (…

cs.LG2023★ 5 cited

STG-MTL: Scalable Task Grouping for Multi-Task Learning Using Data Map

Ammar Sherif, Abubakar Abid, Mustafa Elattar +1

Multi-Task Learning (MTL) is a powerful technique that has gained popularity due to its performance improvement over traditional Single-Task Learning (STL). However, MTL is often c…

cs.LG2021★ 563 cited

Multitask Prompted Training Enables Zero-Shot Task Generalization

Victor Sanh, Albert Webson, Colin Raffel +38

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a…