1 citations · 2 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.AI2024★ 1 cited
KBLaM: Knowledge Base augmented Language Model
Xi Wang, Taketomo Isazawa, Liana Mikaelyan +1
In this paper, we propose Knowledge Base augmented Language Model (KBLaM), a new method for augmenting Large Language Models (LLMs) with external knowledge. KBLaM works with a know…
cs.LG2024★ 1 cited
How to set AdamW's weight decay as you scale model and dataset size
Xi Wang, Laurence Aitchison
The scaling of the optimal AdamW weight decay hyperparameter with model and dataset size is critical as we seek to build larger models, but is poorly understood. We show that weigh…