Several categories of Large Language Models (LLMs): A Short Survey

Abstract

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments and efforts made for various LLM kinds, including task-based financial LLMs, multilingual language LLMs, biomedical and clinical LLMs, vision language LLMs, and code language models. The survey gives a general summary of the methods, attributes, datasets, transformer models, and comparison metrics applied in each category of LLMs. Furthermore, it highlights unresolved problems in the field of developing chatbots and virtual assistants, such as boosting natural language processing, enhancing chatbot intelligence, and resolving moral and legal dilemmas. The purpose of this study is to provide readers, developers, academics, and users interested in LLM-based chatbots and virtual intelligent assistant technologies with useful information and future directions.

References in corpus (41)

• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
• Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
• PaLM: Scaling Language Modeling with Pathways
• Microsoft COCO Captions: Data Collection and Evaluation Server
• A Survey of Large Language Models
• Scaling Laws for Neural Language Models
• Evaluating Large Language Models Trained on Code
• Flamingo: a Visual Language Model for Few-Shot Learning
• Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
• SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
• Publicly Available Clinical BERT Embeddings
• Training Compute-Optimal Large Language Models
• The Pile: An 800GB Dataset of Diverse Text for Language Modeling
• MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
• CodeSearchNet Challenge: Evaluating the State of Semantic Code Search
• LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs
• BloombergGPT: A Large Language Model for Finance
• Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
• GLM-130B: An Open Bilingual Pre-trained Model
• MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographs
• CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesis
• PaLI: A Jointly-Scaled Multilingual Language-Image Model
• Instruction Tuning with GPT-4
• Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation
• NegBio: a high-performance tool for negation and uncertainty detection in radiology reports
• WizardLM: Empowering large pre-trained language models to follow complex instructions
• WizardCoder: Empowering Code Large Language Models with Evol-Instruct
• The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
• GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records
• PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance
• AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model
• F-VLM: Open-Vocabulary Object Detection upon Frozen Vision and Language Models
• DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation
• MiniVLM: A Smaller and Faster Vision-Language Model
• FinGPT: Open-Source Financial Large Language Models
• REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments
• yosm: A new yoruba sentiment corpus for movie reviews
• RadBERT-CL: Factually-Aware Contrastive Learning For Radiology Report Classification
• BioMegatron: Larger Biomedical Domain Language Model
• LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation
• AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languages