3 citations · 4 across the 6 of their papers we have counts for
Showing cs.ITShow all
2 papers · 1 filter
cs.IT2026
An Information-Theoretic Perspective on LLM Tokenizers
Mete Erdogan, Abhiram Gorle, Shubham Chandak +2
Large language model (LLM) tokenizers act as structured compressors: by mapping text to discrete token sequences, they determine token count (and thus compute and context usage) an…
cs.IT2021
On Coding for an Abstracted Nanopore Channel for DNA Storage
Reyna Hulett, Shubham Chandak, Mary Wootters
In the emerging field of DNA storage, data is encoded as DNA sequences and stored. The data is read out again by sequencing the stored DNA. Nanopore sequencing is a new sequencing…