TedNet: A Pytorch Toolkit for Tensor Decomposition Networks
arXiv:2104.05018 · doi:10.1016/j.neucom.2021.10.064
Abstract
Tensor Decomposition Networks (TDNs) prevail for their inherent compact architectures. To give more researchers a flexible way to exploit TDNs, we present a Pytorch toolkit named TedNet. TedNet implements 5 kinds of tensor decomposition(i.e., CANDECOMP/PARAFAC (CP), Block-Term Tucker (BTT), Tucker-2, Tensor Train (TT) and Tensor Ring (TR) on traditional deep neural layers, the convolutional layer and the fully-connected layer. By utilizing the basic layers, it is simple to construct a variety of TDNs. TedNet is available at https://github.com/tnbar/tednet.
Accepted in Neurocomputing
References in corpus (5)
- The NumPy array: a structure for efficient numerical computation
- Tensor Methods in Computer Vision and Deep Learning
- TensorNetwork: A Library for Physics and Machine Learning
- Tensor-Train Recurrent Neural Networks for Video Classification
- On-FPGA Training with Ultra Memory Reduction: A Low-Precision Tensor Method