4 citations · 28 across the 86 of their papers we have counts for
4 papers · 1 filter
TERM Model: Tensor Ring Mixture Model for Density Estimation
Ruituo Wu, Jiani Liu, Ce Zhu +3
Efficient probability density estimation is a core challenge in statistical machine learning. Tensor-based probabilistic graph methods address interpretability and stability concer…
Run LoRA Run: Faster and Lighter LoRA Implementations
Daria Cherniuk, Aleksandr Mikhalev, Ivan Oseledets
LoRA is a technique that reduces the number of trainable parameters in a neural network by introducing low-rank adapters to linear layers. This technique is used both for fine-tuni…
The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models
Anton Razzhigaev, Matvey Mikhalchuk, Elizaveta Goncharova +3
In this study, we present an investigation into the anisotropy dynamics and intrinsic dimension of embeddings in transformer architectures, focusing on the dichotomy between encode…
Memory-efficient particle filter recurrent neural network for object localization
Roman Korkin, Ivan Oseledets, Aleksandr Katrutsa
This study proposes a novel memory-efficient recurrent neural network (RNN) architecture specified to solve the object localization problem. This problem is to recover the object s…