grapheme-kit: Grapheme-Level Metrics and Text Processing for Multilingual NLP

Izzath Nisfer, Ashini Kavindya, Ovindu Atukorala +2

Existing lexical distance, similarity, and evaluation metrics operate on Unicode code points, which can misrepresent errors in writing systems where a single grapheme is represente…