COMMITS
/ Parser/tokenizer.c July 26, 2023
P
gh-107015: Remove async_hacks from the tokenizer (#107018)
Pablo Galindo Salgado committed
July 22, 2023
M
gh-106989: Remove tok report warnings (#106993)
Menelaos Kotoglou committed
July 2, 2023
I
gh-104922: remove PY_SSIZE_T_CLEAN (#106315)
Inada Naoki committed
June 20, 2023
L
gh-105938: Emit a SyntaxWarning for escaped braces in an f-string (#105939)
Lysandros Nikolaou committed
June 15, 2023
L
gh-105820: Fix tok_mode expression buffer in file & readline tokenizer (#105828)
Lysandros Nikolaou committed
June 13, 2023
L
gh-105718: Fix buffer allocation in tokenizer with readline (#105728)
Lysandros Nikolaou committed
June 9, 2023
P
gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-prefixed literals (#105555)
Pablo Galindo Salgado committed
June 6, 2023
P
gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (#105364)
Pablo Galindo Salgado committed
May 30, 2023
L
gh-105042: Disable unmatched parens syntax error in python tokenize (#105061)
Lysandros Nikolaou committed
P
gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (#105070)
Pablo Galindo Salgado committed
May 28, 2023
M
gh-105017: Include CRLF lines in strings and column numbers (#105030)
Marta Gómez Macías committed
May 27, 2023
M
gh-105017: Fix including additional NL token when using CRLF (#105022)
Marta Gómez Macías committed
P
Fix indentation in Parser/tokenizer.c (#105012)
Petr Vaněk committed
May 24, 2023
L
gh-104866: Tokenize should emit NEWLINE after exiting block with comment (#104870)
Lysandros Nikolaou committed
May 22, 2023
C
gh-102856: Allow comments inside multi-line f-string expresions (#104006)
Cristián Maureira-Fredes committed
May 21, 2023
S
gh-98836: Extend PyUnicode_FromFormat() (GH-98838)
Serhiy Storchaka committed
M
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías committed
May 20, 2023
P
gh-104658: Fix location of unclosed quote error for multiline f-strings (#104660)
Pablo Galindo Salgado committed
May 8, 2023
H
Trim trailing whitespace and test on CI (#104275)
Hugo van Kemenade committed
May 4, 2023
P
gh-104169: Ensure the tokenizer doesn't overwrite previous errors (#104170)
Pablo Galindo Salgado committed
L
gh-97556: Raise null bytes syntax error upon null in multiline string (GH-104136)
Lysandros Nikolaou committed
May 1, 2023
J
gh-104016: Fixed off by 1 error in f string tokenizer (#104047)
jx124 committed
C
gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)
chgnrdv committed
April 27, 2023
L
gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-103896)
Lysandros Nikolaou committed
April 25, 2023
L
gh-103718: Correctly set f-string buffers in all cases (GH-103815)
Lysandros Nikolaou committed
April 24, 2023
L
GH-103727: Avoid advancing tokenizer too far in f-string mode (GH-103775)
Lysandros Nikolaou committed
April 23, 2023
L
GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)
Lysandros Nikolaou committed
April 19, 2023
P
gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)
Pablo Galindo Salgado committed
P
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado committed
November 30, 2022
P
gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-99893)
Pablo Galindo Salgado committed
November 20, 2022
P
gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill the available buffer (#99605)
Pablo Galindo Salgado committed
November 10, 2022
V
gh-99300: Use Py_NewRef() in Parser/ directory (#99330)
Victor Stinner committed
October 7, 2022
L
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou committed
October 6, 2022
L
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou committed
September 27, 2022
P
gh-96670: Raise SyntaxError when parsing NULL bytes (#97594)
Pablo Galindo Salgado committed
September 13, 2022
M
gh-96678: Fix UB of null pointer arithmetic (GH-96782)
Matthias Görgens committed
September 7, 2022
M
gh-96268: Fix loading invalid UTF-8 (#96270)
Michael Droettboom committed
September 6, 2022
M
gh-96611: Fix error message for invalid UTF-8 in mid-multiline string (#96623)
Michael Droettboom committed
July 5, 2022
P
gh-94360: Fix a tokenizer crash when reading encoded files with syntax errors from stdin (#94386)
Pablo Galindo Salgado committed
June 14, 2022
S
gh-93741: Add private C API _PyImport_GetModuleAttrString() (GH-93742)
Serhiy Storchaka committed
May 27, 2022
K
GH-93207: Remove HAVE_STDARG_PROTOTYPES configure check for stdarg.h (#93215)
Kumar Aditya committed
May 24, 2022
V
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner committed
May 11, 2022
V
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner committed
April 27, 2022
S
gh-87999: Change warning type for numeric literal followed by keyword (GH-91980)
Serhiy Storchaka committed
April 2, 2022
C
bpo-46315: Use fopencookie only on Emscripten 3.x and newer (GH-32266)
Christian Heimes committed
March 30, 2022
H
bpo-47126: Update to canonical PEP URLs specified by PEP 676 (GH-32124)
Hugo van Kemenade committed
March 22, 2022
C
bpo-46315: Use fopencookie() to avoid dup() in _PyTokenizer_FindEncodingFilename (GH-32033)
Christian Heimes committed
March 14, 2022
O
bpo-46920: Remove code that has explainers why it was disabled (GH-31813)
Oleg Iarygin committed
February 22, 2022
S
bpo-46820: Fix a SyntaxError in a numeric literal followed by "not in" (GH-31479)
Serhiy Storchaka committed
February 8, 2022