papers
Publications (3)
cs.LG2025
Using Scaling Laws for Data Source Utility Estimation in Domain-Specific Pre-Training
Oleksiy Ostapenko, Charles Guille-Escuret, Luke Kumar +7
cs.SE2024
StarCoder 2 and The Stack v2: The Next Generation
Anton Lozhkov, Raymond Li, Loubna Ben Allal +63
cs.CL2020
An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain
Paul Grouchy, Shobhit Jain, Michael Liu +7