Hyperbolic Deep Neural Networks: A Survey
arXiv:2101.04562
Abstract
Recently, there has been a rising surge of momentum for deep representation learning in hyperbolic spaces due to theirhigh capacity of modeling data like knowledge graphs or synonym hierarchies, possessing hierarchical structure. We refer to the model as hyperbolic deep neural network in this paper. Such a hyperbolic neural architecture potentially leads to drastically compact model withmuch more physical interpretability than its counterpart in Euclidean space. To stimulate future research, this paper presents acoherent and comprehensive review of the literature around the neural components in the construction of hyperbolic deep neuralnetworks, as well as the generalization of the leading deep approaches to the Hyperbolic space. It also presents current applicationsaround various machine learning tasks on several publicly available datasets, together with insightful observations and identifying openquestions and promising future directions.
References in corpus (20)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Semi-Supervised Classification with Graph Convolutional Networks
- ADADELTA: An Adaptive Learning Rate Method
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- On the Convergence of Adam and Beyond
- Deep Convolutional Networks on Graph-Structured Data
- Hyperbolic Geometry of Complex Networks
- Person Re-identification: Past, Present and Future
- On Differentiating Parameterized Argmin and Argmax Problems with Application to Bi-level Optimization
- Hyperbolic Graph Neural Networks
- Higher-Order Factorization Machines
- Geoopt: Riemannian Optimization in PyTorch
- Normalizing Flows on Riemannian Manifolds
- Scalable Hyperbolic Recommender Systems
- Hyperbolic Graph Attention Network
- Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition
- Hyperbolic Deep Learning for Chinese Natural Language Understanding
- Are Hyperbolic Representations in Graphs Created Equal?
- Tiling the Euclidean and Hyperbolic planes with ribbons