Infinite Mixture Prototypes for Few-Shot Learning

Abstract

We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Our infinite mixture prototypes represent each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clusters, infinite mixture prototypes interpolate between nearest neighbor and prototypical representations, which improves accuracy and robustness in the few-shot regime. We show the importance of adaptive capacity for capturing complex data distributions such as alphabets, with 25% absolute accuracy improvements over prototypical networks, while still maintaining or improving accuracy on the standard Omniglot and mini-ImageNet benchmarks. In clustering labeled and unlabeled data by the same clustering rule, infinite mixture prototypes achieves state-of-the-art semi-supervised accuracy. As a further capability, we show that infinite mixture prototypes can perform purely unsupervised clustering, unlike existing prototypical methods.

Cited by in corpus (18)

• BSNet: Bi-Similarity Network for Few-shot Fine-grained Image Classification
• Self-supervised Knowledge Distillation for Few-shot Learning
• Prototype Guided Federated Learning of Visual Feature Representations
• Multi-scale Adaptive Task Attention Network for Few-Shot Learning
• Distance-wise Prototypical Graph Neural Network in Node Imbalance Classification
• Contrastive Prototype Learning with Augmented Embeddings for Few-Shot Learning
• Dynamic Memory Induction Networks for Few-Shot Text Classification
• Few-shot tweet detection in emerging disaster events
• Hierarchical Representation based Query-Specific Prototypical Network for Few-Shot Image Classification
• Few-Shot Learning with Intra-Class Knowledge Transfer
• Introducing the structural bases of typicality effects in deep learning
• Multi-Label Few-Shot Learning for Aspect Category Detection
• Interpretable Time-series Classification on Few-shot Samples
• Asymmetric Distribution Measure for Few-shot Learning
• Fuzzy Simplicial Networks: A Topology-Inspired Model to Improve Task Generalization in Few-shot Learning
• Variable-Shot Adaptation for Online Meta-Learning
• Enabling the Network to Surf the Internet
• One-shot Learning with Absolute Generalization