activity
20242026
most citedD-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

3 citations · 3 across the 7 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

cs.CL2024★ 3 cited

D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

Haoran Que, Jiaheng Liu, Ge Zhang +13

Continual Pre-Training (CPT) on Large Language Models (LLMs) has been widely used to expand the model's fundamental understanding of specific downstream domains (e.g., math and cod…

cs.CL2024

LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation

Keheng Wang, Feiyu Duan, Peiguang Li +2

Retrieval-Augmented Generation (RAG) demonstrates great value in alleviating outdated knowledge or hallucination by supplying LLMs with updated and relevant knowledge. However, the…