3 papers
cs.CL2025
Synthetic bootstrapped pretraining
Zitong Yang, Aonan Zhang, Hong Liu +4
We introduce Synthetic Bootstrapped Pretraining (SBP), a language model (LM) pretraining procedure that first learns a model of relations between documents from the pretraining dat…
cs.AR2025
A Multi-Agent Generative AI Framework for IC Module-Level Verification Automation
Wenbo Liu, Forbes Hou, Jon Zhang +2
As large language models demonstrate enormous potential in the field of Electronic Design Automation (EDA), generative AI-assisted chip design is attracting widespread attention fr…
cs.CL2024
DoubleCCA: Improving Foundation Model Group Robustness with Random Sentence Embeddings
Hong Liu, Yitong Lu
This paper presents a novel method to improve the robustness of foundation models to group-based biases. We propose a simple yet effective method, called DoubleCCA, that leverages…