20 citations · 43 across the 29 of their papers we have counts for
4 papers · 1 filter
Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings
Maxat Tezekbayev, Zhenisbek Assylbekov, Rustem Takhanov
We show that the skip-gram embedding of any word can be decomposed into two subvectors which roughly correspond to semantic and syntactic roles of the word.
Reducing the dimensionality of data using tempered distributions
Rustem Takhanov
We reformulate unsupervised dimension reduction problem (UDR) in the language of tempered distributions, i.e. as a problem of approximating an empirical probability density functio…
Context Vectors are Reflections of Word Vectors in Half the Dimensions
Zhenisbek Assylbekov, Rustem Takhanov
This paper takes a step towards theoretical analysis of the relationship between word embeddings and context embeddings in models such as word2vec. We start from basic probabilisti…
Fourier Neural Networks: A Comparative Study
Abylay Zhumekenov, Malika Uteuliyeva, Olzhas Kabdolov +3
We review neural network architectures which were motivated by Fourier series and integrals and which are referred to as Fourier neural networks. These networks are empirically eva…