6 citations · 18 across the 16 of their papers we have counts for
20 papers · 1 filter
OMPar: Automatic Parallelization with AI-Driven Source-to-Source Compilation
Tal Kadosh, Niranjan Hasabnis, Prema Soundararajan +5
Manual parallelization of code remains a significant challenge due to the complexities of modern software systems and the widespread adoption of multi-core architectures. This pape…
Protecting Privacy in Classifiers by Token Manipulation
Re'em Harel, Yair Elboher, Yuval Pinter
Using language models as a remote service entails sending private information to an untrusted provider. In addition, potential eavesdroppers can intercept the messages, thereby exp…
Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge
Khuyagbaatar Batsuren, Ekaterina Vylomova, Verna Dankers +4
The popular subword tokenizers of current language models, such as Byte-Pair Encoding (BPE), are known not to respect morpheme boundaries, which affects the downstream performance…
An Analysis of BPE Vocabulary Trimming in Neural Machine Translation
Marco Cognetta, Tatsuya Hiraoka, Naoaki Okazaki +2
We explore threshold vocabulary trimming in Byte-Pair Encoding subword tokenization, a postprocessing step that replaces rare subwords with their component subwords. The technique…
BiVert: Bidirectional Vocabulary Evaluation using Relations for Machine Translation
Carinne Cherf, Yuval Pinter
Neural machine translation (NMT) has progressed rapidly in the past few years, promising improvements and quality translations for different languages. Evaluation of this task is c…
Analyzing Cognitive Plausibility of Subword Tokenization
Lisa Beinborn, Yuval Pinter
Subword tokenization has become the de-facto standard for tokenization, although comparative evaluations of subword vocabulary quality across languages are scarce. Existing evaluat…