activity
20192026
most citedStarCoder: may the source be with you!

200 citations · 332 across the 9 of their papers we have counts for

collaborators

10 papers

cs.RO2026

Recover, Discover, Plan: Learning Skills and Concepts from Robot Failures

Bowen Li, Mayank Mishra, Y. Isabel Liu +7

Intelligent robots should not only recover from failures, but also acquire the abstract knowledge needed to avoid them in the future. While reinforcement learning (RL) can learn re…

cs.CL2024★ 1 cited

Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code

Taishi Nakamura, Mayank Mishra, Simone Tedeschi +42

Pretrained language models are an integral part of AI applications, but their high computational cost for training limits accessibility. Initiatives such as Bloom and StarCoder aim…

cs.SE2024★ 67 cited

StarCoder 2 and The Stack v2: The Next Generation

Anton Lozhkov, Raymond Li, Loubna Ben Allal +63

The BigCode project, an open-scientific collaboration focused on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder2. In partnership wi…

cs.CL2023

Prompting with Pseudo-Code Instructions

Mayank Mishra, Prince Kumar, Riyaz Bhat +3

Prompting with natural language instructions has recently emerged as a popular method of harnessing the capabilities of large language models. Given the inherent ambiguity present…

cs.CL2023★ 200 cited

StarCoder: may the source be with you!

Raymond Li, Loubna Ben Allal, Yangtian Zi +64

The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase…

cs.SE2023★ 54 cited

SantaCoder: don't reach for the stars!

Loubna Ben Allal, Raymond Li, Denis Kocetkov +38

The BigCode project is an open-scientific collaboration working on the responsible development of large language models for code. This tech report describes the progress of the col…

cs.CL2022

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

BigScience Workshop, :, Teven Le Scao +391

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to wi…

cs.CL2022

Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog

Mayank Mishra, Danish Contractor, Dinesh Raghu

Traditional systems designed for task oriented dialog utilize knowledge present only in structured knowledge sources to generate responses. However, relevant information required t…

cs.CL2021★ 1 cited

Variational Learning for Unsupervised Knowledge Grounded Dialogs

Mayank Mishra, Dhiraj Madan, Gaurav Pandey +1

Recent methods for knowledge grounded dialogs generate responses by incorporating information from an external textual document. These methods do not require the exact document to…

eess.AS2019★ 9 cited

Adversarial Approximate Inference for Speech to Electroglottograph Conversion

Prathosh A. P., Varun Srivastava, Mayank Mishra

Speech produced by human vocal apparatus conveys substantial non-semantic information including the gender of the speaker, voice quality, affective state, abnormalities in the voca…