2 papers
cs.CL2026
Pretraining Language Models with Subword Regularization: An Empirical Study of BPE Dropout in Low-Resource NLP
Ruan Visser, Trienko Grobler, Marcel Dunaiski
Subword regularization methods such as BPE dropout are typically applied only during fine-tuning, while pretraining is usually done with deterministic tokenization. This creates a…
astro-ph.IM2025
Anomaly detection in radio galaxy data with trainable COSFIRE filters
Steven Ndung'u, Trienko Grobler, Stefan J. Wijnholds +1
Detecting anomalies in radio astronomy is challenging due to the vast amounts of data and the rarity of labeled anomalous examples. Addressing this challenge requires efficient met…