bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)
* Always set the text attribute. * Correct the offset attribute for non-ascii sources.
S
Serhiy Storchaka committed
0cc6b5e559b8303b18fdd56c2befd900fe7b5e35
Parent: f4f445b
Committed by GitHub <noreply@github.com>
on 2/12/2020, 10:17:00 AM