SIGN IN SIGN UP

gh-96268: Fix loading invalid UTF-8 (GH-96270)

This makes tokenizer.c:valid_utf8 match stringlib/codecs.h:decode_utf8.

It also fixes an off-by-one error introduced in 3.10 for the line number when the tokenizer reports bad UTF8.
(cherry picked from commit 8bc356a7dd50cbdb46d10b8c7e457832431f5d9e)

Co-authored-by: Michael Droettboom <mdboom@gmail.com>
M
Miss Islington (bot) committed
ffafa9b91da8731d21958209dd1478f48eaa2d09
Parent: 9fa21d0
Committed by GitHub <noreply@github.com> on 9/7/2022, 9:49:17 PM