bpo-40334: Catch E_EOF error, when the tokenizer returns ERRORTOKEN (GH-19743)
An E_EOF error was only being caught after the parser exited before this commit. There are some cases though, where the tokenizer returns ERRORTOKEN *and* has set an E_EOF error (like when EOF directly follows a line continuation character) which weren't correctly handled before.
L
Lysandros Nikolaou committed
d55133f49fe678fbf047a647aa8bb8b520410e8d
Parent: 5d1f32d
Committed by GitHub <noreply@github.com>
on 4/28/2020, 12:23:35 AM