An overview of domain-specific foundation model: key technologies, applications and challenges
arXiv:2409.04267 · doi:10.1007/s11432-025-4498-2
Abstract
The impressive performance of ChatGPT and other foundation-model-based products in human language understanding has prompted both academia and industry to explore how these models can be tailored for specific industries and application scenarios. This process, known as the customization of domain-specific foundation models (FMs), addresses the limitations of general-purpose models, which may not fully capture the unique patterns and requirements of domain-specific data. Despite its importance, there is a notable lack of comprehensive overview papers on building domain-specific FMs, while numerous resources exist for general-purpose models. To bridge this gap, this article provides a timely and thorough overview of the methodology for customizing domain-specific FMs. It introduces basic concepts, outlines the general architecture, and surveys key methods for constructing domain-specific models. Furthermore, the article discusses various domains that can benefit from these specialized models and highlights the challenges ahead. Through this overview, we aim to offer valuable guidance and reference for researchers and practitioners from diverse fields to develop their own customized FMs.
References in corpus (5)
- A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
- Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing
- Towards artificial general intelligence via a multimodal foundation model
- The Power of Noise: Redefining Retrieval for RAG Systems
- Overview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunities
Cited by in corpus (4)
- An Encoder-Decoder Foundation Chemical Language Model for Generative Polymer Design
- CSI-BERT2: A BERT-inspired Framework for Efficient CSI Prediction and Classification in Wireless Communication and Sensing
- KNN-MMD: Cross Domain Wireless Sensing via Local Distribution Alignment
- Zero-Effort Image-to-Music Generation: An Interpretable RAG-based VLM Approach