SIGN IN SIGN UP

normalize latin-1 and utf-8 variant encodings like the builtin tokenizer does

B
Benjamin Peterson committed
d3afadaa4908df544e0181c11199e59b1bfb5c37
Parent: ffc08fc