1 paper
Sogol Sanjaripour, Michael J. Smith, Manuel Pérez-Carrasco +3
Tokenization is central to adapting scientific data for transformer-based foundation models, yet its impact on learned representations remains poorly understood. We compare four to…