2 citations · 3 across the 6 of their papers we have counts for
3 papers · 1 filter
Predicting Question-Answering Performance of Large Language Models through Semantic Consistency
Ella Rabinovich, Samuel Ackerman, Orna Raz +2
Semantic consistency of a language model is broadly defined as the model's ability to produce semantically-equivalent outputs, given semantically-equivalent inputs. We address the…
Characterizing how 'distributional' NLP corpora distance metrics are
Samuel Ackerman, George Kour, Eitan Farchi
A corpus of vector-embedded text documents has some empirical distribution. Given two corpora, we want to calculate a single metric of distance (e.g., Mauve, Frechet Inception) bet…
Reliable and Interpretable Drift Detection in Streams of Short Texts
Ella Rabinovich, Matan Vetzler, Samuel Ackerman +1
Data drift is the change in model input data that is one of the key factors leading to machine learning models performance degradation over time. Monitoring drift helps detecting t…