The Harder Text Embedding Benchmark (HTEB): Beyond One-dimensional Static Robustness

Manuel Frank, Haithem Afli

Embedding benchmarks like MTEB report a single score per model, implicitly treating robustness as a static, scalar property. We argue that embedding robustness is multidimensional,…