SEM-CLIP: Precise Few-Shot Learning for Nanoscale Defect Detection in Scanning Electron Microscope Image

Abstract

In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning electron microscope (SEM) images and the diverse textures of the defects pose significant challenges. Traditional methods usually suffer from insufficient data, labels, and poor transferability. In this paper, we propose a novel few-shot learning approach, SEM-CLIP, for accurate defect classification and segmentation. SEM-CLIP customizes the Contrastive Language-Image Pretraining (CLIP) model to better focus on defect areas and minimize background distractions, thereby enhancing segmentation accuracy. We employ text prompts enriched with domain knowledge as prior information to assist in precise analysis. Additionally, our approach incorporates feature engineering with textual guidance to categorize defects more effectively. SEM-CLIP requires little annotated data, substantially reducing labor demands in the semiconductor industry. Extensive experimental validation demonstrates that our model achieves impressive classification and segmentation results under few-shot learning scenarios.

Published in ACM/IEEE International Conference on Computer-Aided Design (ICCAD), 2024

References in corpus (15)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Learning Transferable Visual Models From Natural Language Supervision
• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
• WaferSegClassNet -- A Light-weight Network for Classification and Segmentation of Semiconductor Wafer Defects
• A Closer Look at the Explainability of Contrastive Language-Image Pre-training
• DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detection
• Image Segmentation Using Text and Image Prompts
• SoftPatch: Unsupervised Anomaly Detection with Noisy Data
• WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation
• Multimodal Industrial Anomaly Detection via Hybrid Fusion
• Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
• ZegCLIP: Towards Adapting CLIP for Zero-shot Semantic Segmentation
• Semantic Prompt for Few-Shot Image Recognition
• CLIP-AD: A Language-Guided Staged Dual-Path Model for Zero-shot Anomaly Detection
• SEMI-DiffusionInst: A Diffusion Model Based Approach for Semiconductor Defect Classification and Segmentation