COMMITS
/ Parser/tokenizer.c September 13, 2022
M
gh-96678: Fix UB of null pointer arithmetic (GH-96782)
Miss Islington (bot) committed
September 6, 2022
M
gh-96611: Fix error message for invalid UTF-8 in mid-multiline string (GH-96623)
Miss Islington (bot) committed
July 5, 2022
P
[3.10] gh-94360: Fix a tokenizer crash when reading encoded files with syntax errors from stdin (GH-94386) (GH-94574)
Pablo Galindo Salgado committed
February 22, 2022
M
bpo-46820: Fix a SyntaxError in a numeric literal followed by "not in" (GH-31479) (GH-31493)
Miss Islington (bot) committed
February 8, 2022
P
[3.10] bpo-46521: Fix codeop to use a new partial-input mode of the parser (GH-31010). (GH-31213)
Pablo Galindo Salgado committed
February 3, 2022
M
bpo-14916: use specified tokenizer fd for file input (GH-31006)
Miss Islington (bot) committed
January 25, 2022
P
December 12, 2021
M
bpo-46054: Fix parsing error when parsing non-utf8 characters in source files (GH-30068) (GH-30069)
Miss Islington (bot) committed
November 21, 2021
P
[3.10] Ensure the str member of the tokenizer is always initialised (GH-29681). (GH-29683)
Pablo Galindo Salgado committed
November 14, 2021
M
bpo-45738: Fix computation of error location for invalid continuation (GH-29550)
Miss Islington (bot) committed
October 29, 2021
M
bpo-45562: Ensure all tokenizer debug messages are printed to stderr (GH-29270)
Miss Islington (bot) committed
October 27, 2021
M
bpo-45562: Print tokenizer debug messages to stderr (GH-29250) (GH-29252)
Miss Islington (bot) committed
October 23, 2021
M
bpo-45574: fix warning about `print_escape` being unused (GH-29172) (#29176)
Miss Islington (bot) committed
October 22, 2021
M
bpo-45562: Only show debug output from the parser in debug builds (GH-29140) (#29149)
Miss Islington (bot) committed
July 30, 2021
M
Update URLs in comments and metadata to use HTTPS (GH-27458) (GH-27478)
Miss Islington (bot) committed
July 10, 2021
M
bpo-44317: Improve tokenizer errors with more informative locations (GH-26555) (GH-27079)
Miss Islington (bot) committed
June 12, 2021
M
bpo-44396: Update multi-line-start location when reallocating tokenizer buffers (GH-26676) (GH-26695)
Miss Islington (bot) committed
June 8, 2021
M
bpo-43833: Emit warnings for numeric literals followed by keyword (GH-25466)
Miss Islington (bot) committed
May 22, 2021
M
bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298) (GH-26313)
Miss Islington (bot) committed
March 29, 2021
P
Fix tokenizer error when raw decoding null bytes (GH-25080)
Pablo Galindo committed
March 28, 2021
P
bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)
Pablo Galindo committed
March 14, 2021
P
January 20, 2021
B
bpo-40176: Improve error messages for unclosed string literals (GH-19346)
Batuhan Taskaya committed
January 19, 2021
P
bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)
Pablo Galindo committed
January 14, 2021
L
bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)
Lysandros Nikolaou committed
December 1, 2020
V
bpo-42519: Replace PyMem_MALLOC() with PyMem_Malloc() (GH-23586)
Victor Stinner committed
June 15, 2020
V
bpo-36020: Remove snprintf macro in pyerrors.h (GH-20889)
Victor Stinner committed
June 10, 2020
L
bpo-40847: Consider a line with only a LINECONT a blank line (GH-20769)
Lysandros Nikolaou committed
May 26, 2020
A
Fix peg_generator compiler warnings under MSVC (GH-20405)
Ammar Askar committed
May 12, 2020
S
bpo-40593: Improve syntax errors for invalid characters in source code. (GH-20033)
Serhiy Storchaka committed
May 4, 2020
L
bpo-40246: Revert reporting of invalid string prefixes (GH-19888)
Lysandros Nikolaou committed
April 21, 2020
P
bpo-40335: Correctly handle multi-line strings in tokenize error scenarios (GH-19619)
Pablo Galindo committed
April 12, 2020
L
bpo-40246: Report a better error message for invalid string prefixes (GH-19476)
Lysandros Nikolaou committed
March 25, 2020
V
bpo-39882: Add _Py_FatalErrorFormat() function (GH-19157)
Victor Stinner committed
March 6, 2020
V
bpo-39882: Py_FatalError() logs the function name (GH-18819)
Victor Stinner committed
February 28, 2020
A
closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)
Andy Lester committed
February 12, 2020
S
bpo-39219: Fix SyntaxError attributes in the tokenizer. (GH-17828)
Serhiy Storchaka committed
February 11, 2020
V
bpo-39500: Document PyUnicode_IsIdentifier() function (GH-18397)
Victor Stinner committed
January 6, 2020
P
bpo-39209: Manage correctly multi-line tokens in interactive mode (GH-17860)
Pablo Galindo committed
December 9, 2019
B
bpo-38673: dont switch to ps2 if the line starts with comment or whitespace (GH-17421)
Batuhan Taşkaya committed
August 15, 2019
H
Indent code inside if block. (GH-15284)
Hansraj Das committed
July 29, 2019
A
Fix `SyntaxError` indicator printing too many spaces for multi-line strings (GH-14433)
Anthony Sottile committed
May 22, 2019
M
bpo-36878: Only allow text after `# type: ignore` if first character ASCII (GH-13504)
Michael J. Sullivan committed
M
bpo-36878: Track extra text added to 'type: ignore' in the AST (GH-13479)
Michael J. Sullivan committed
May 18, 2019
A
bpo-2180: Treat line continuation at EOF as a `SyntaxError` (GH-13401)
Anthony Sottile committed
May 11, 2019
M
bpo-36878: Allow extra text after `# type: ignore` comments (GH-13238)
Michael J. Sullivan committed
April 13, 2019
P
bpo-36623: Clean parser headers and include files (GH-12253)
Pablo Galindo committed
March 28, 2019
Z
bpo-36459: Fix a possible double PyMem_FREE() due to tokenizer.c's tok_nextc() (12601)
Zackery Spytz committed
March 19, 2019
P
bpo-36367: Free buffer if realloc fails in tokenize.c (GH-12442)
Pablo Galindo committed