COMMITS
/ Parser/tokenizer.h July 22, 2023
M
[3.12] gh-106989: Remove tok report warnings (GH-106993) (#107013)
Miss Islington (bot) committed
June 13, 2023
M
[3.12] gh-105718: Fix buffer allocation in tokenizer with readline (GH-105728) (#105729)
Miss Islington (bot) committed
June 6, 2023
M
[3.12] gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (GH-105364) (#105367)
Miss Islington (bot) committed
May 31, 2023
M
[3.12] gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (GH-105070) (#105119)
Miss Islington (bot) committed
May 28, 2023
M
[3.12] gh-105017: Include CRLF lines in strings and column numbers (GH-105030) (#105041)
Miss Islington (bot) committed
May 26, 2023
M
[3.12] Fix typo in the tokenizer (GH-104950) (#104953)
Miss Islington (bot) committed
May 21, 2023
M
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías committed
May 20, 2023
P
gh-104658: Fix location of unclosed quote error for multiline f-strings (#104660)
Pablo Galindo Salgado committed
May 1, 2023
J
gh-104016: Fixed off by 1 error in f string tokenizer (#104047)
jx124 committed
April 27, 2023
L
gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-103896)
Lysandros Nikolaou committed
April 23, 2023
L
GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)
Lysandros Nikolaou committed
April 19, 2023
P
gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)
Pablo Galindo Salgado committed
P
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado committed
November 30, 2022
P
gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-99893)
Pablo Galindo Salgado committed
October 7, 2022
L
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou committed
October 6, 2022
L
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou committed
May 24, 2022
V
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner committed
May 11, 2022
V
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner committed
November 21, 2021
P
Ensure the str member of the tokenizer is always initialised (GH-29681)
Pablo Galindo Salgado committed
October 13, 2021
V
bpo-45434: Mark the PyTokenizer C API as private (GH-28924)
Victor Stinner committed
October 6, 2021
C
Fix typos in the Objects directory (GH-28766)
Christian Clauss committed
August 9, 2021
S
bpo-44854: Remove trailing whitespaces (GH-27689)
Serhiy Storchaka committed
May 22, 2021
P
bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)
Pablo Galindo committed
March 28, 2021
P
bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)
Pablo Galindo committed
March 14, 2021
P
January 19, 2021
P
bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)
Pablo Galindo committed
January 14, 2021
L
bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)
Lysandros Nikolaou committed
February 28, 2020
A
closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)
Andy Lester committed
April 13, 2019
P
bpo-36623: Clean parser headers and include files (GH-12253)
Pablo Galindo committed
March 7, 2019
G
bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)
Guido van Rossum committed
March 1, 2019
P
bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)
Pablo Galindo committed
January 31, 2019
G
bpo-35766: Merge typed_ast back into CPython (GH-11645)
Guido van Rossum committed
January 13, 2019
A
bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)
Anthony Sottile committed
December 17, 2018
S
bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)
Serhiy Storchaka committed
November 17, 2017
V
tokenizer: Remove unused tabs options (#4422)
Victor Stinner committed
October 6, 2017
J
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra committed
April 3, 2017
J
Remove obsolete declaration in tokenizer.h (#962)
Jim Fasarakis-Hilliard committed
July 23, 2015
Y
Issue #24619: Simplify async/await tokenization.
Yury Selivanov committed
July 22, 2015
Y
Issue #24619: New approach for tokenizing async/await.
Yury Selivanov committed
May 12, 2015
Y
PEP 0492 -- Coroutines with async and await syntax. Issue #24017.
Yury Selivanov committed
October 19, 2013
S
Issue #1772673: The type of `char*` arguments now changed to `const char*`.
Serhiy Storchaka committed
April 4, 2011
V
Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.
Victor Stinner committed
V
Issue #10785: Store the filename as Unicode in the Python parser.
Victor Stinner committed
October 29, 2010
G
#10222: fix for overzealous AIX compiler.
Georg Brandl committed
October 16, 2010
V
Issue #9713, #10114: Parser functions (eg. PyParser_ASTFromFile) expects
Victor Stinner committed
October 14, 2010
V
Issue #10095: fp_setreadl() doesn't reopen the file, reuse instead the file
Victor Stinner committed
May 9, 2010
A
Recorded merge of revisions 81029 via svnmerge from
Antoine Pitrou committed
November 13, 2009
B
Merged revisions 76230 via svnmerge from
Benjamin Peterson committed
March 2, 2009
B
ignore the coding cookie in compile(), exec(), and eval() if the source is a string #4626
Benjamin Peterson committed
October 17, 2008
B
Latin-1 source code was not being properly decoded when passed through
Brett Cannon committed