activity
20242026
most citedBridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarking

2 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing cs.ITShow all

1 paper · 1 filter

cs.IT2026

An Information-Theoretic Perspective on LLM Tokenizers

Mete Erdogan, Abhiram Gorle, Shubham Chandak +2

Large language model (LLM) tokenizers act as structured compressors: by mapping text to discrete token sequences, they determine token count (and thus compute and context usage) an…