Fixing ill-formed UTF-16 strings with SIMD instructions

Robert Clausecker, Daniel Lemire

UTF-16 is a widely used Unicode encoding representing characters with one or two 16-bit code units. The format relies on surrogate pairs to encode characters beyond the Basic Multi…