4 citations · 4 across the 2 of their papers we have counts for
2 papers
cs.CL2024★ 4 cited
Data Engineering for Scaling Language Models to 128K Context
Yao Fu, Rameswar Panda, Xinyao Niu +4
We study the continual pretraining recipe for scaling language models' context lengths to 128K, with a focus on data engineering. We hypothesize that long context modeling, in part…
cs.CL2024
Machine Unlearning of Pre-trained Large Language Models
Jin Yao, Eli Chien, Minxin Du +4
This study investigates the concept of the `right to be forgotten' within the context of large language models (LLMs). We explore machine unlearning as a pivotal solution, with a f…