Subword Tokenization Strategies for Kurdish Word Embeddings

Ali Salehi, Cassandra L. Jacobs

We investigate tokenization strategies for Kurdish word embeddings by comparing word-level, morpheme-based, and BPE approaches on morphological similarity preservation tasks. We de…