most cited1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality Data

1 citations · 1 across the 2 of their papers we have counts for

collaborators

2 papers

cs.CL2024★ 1 cited

1.5-Pints Technical Report: Pretraining in Days, Not Months -- Your Language Model Thrives on Quality Data

Calvin Tan, Jerome Wang

This paper presents a compute-efficient approach to pre-training a Language Model-the "1.5-Pints"-in only 9 days, while outperforming state-of-the-art models as an instruction-foll…

cs.CR2021

Accountability and Forensics in Blockchains: XDC Consensus Engine DPoS 2.0

Gerui Wang, Jerome Wang, Liam Lai +1

This document introduces XinFin DPoS 2.0, the proposed next generation decentralized consensus engine for the XinFin XDC Network. Built upon the most advanced BFT consensus protoco…