COMMITS
/ Parser/tokenizer.c October 16, 2023
L
[3.12] gh-107450: Check for overflow in the tokenizer and fix overflow test (GH-110832) (#110931)
Lysandros Nikolaou committed
October 5, 2023
M
[3.12] gh-110259: Fix f-strings with multiline expressions and format specs (GH-110271) (#110396)
Miss Islington (bot) committed
October 2, 2023
M
[3.12] gh-88943: Improve syntax error for non-ASCII character that follows a numerical literal (GH-109081) (#109090)
Miss Islington (bot) committed
August 15, 2023
M
[3.12] gh-107967: Fix infinite recursion on invalid escape sequence warning (GH-107968) (#107970)
Miss Islington (bot) committed
July 22, 2023
M
[3.12] gh-106989: Remove tok report warnings (GH-106993) (#107013)
Miss Islington (bot) committed
June 20, 2023
M
[3.12] gh-105938: Emit a SyntaxWarning for escaped braces in an f-string (GH-105939) (#105941)
Miss Islington (bot) committed
June 15, 2023
M
[3.12] gh-105820: Fix tok_mode expression buffer in file & readline tokenizer (GH-105828) (#105832)
Miss Islington (bot) committed
June 13, 2023
M
[3.12] gh-105718: Fix buffer allocation in tokenizer with readline (GH-105728) (#105729)
Miss Islington (bot) committed
June 9, 2023
M
[3.12] gh-105549: Tokenize separately NUMBER and NAME tokens and allow 0-prefixed literals (GH-105555) (#105602)
Miss Islington (bot) committed
June 6, 2023
M
[3.12] gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (GH-105364) (#105367)
Miss Islington (bot) committed
May 31, 2023
M
[3.12] gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (GH-105070) (#105119)
Miss Islington (bot) committed
M
[3.12] gh-105042: Disable unmatched parens syntax error in python tokenize (GH-105061) (#105120)
Miss Islington (bot) committed
May 28, 2023
M
[3.12] gh-105017: Include CRLF lines in strings and column numbers (GH-105030) (#105041)
Miss Islington (bot) committed
May 27, 2023
M
[3.12] gh-105017: Fix including additional NL token when using CRLF (GH-105022) (#105023)
Miss Islington (bot) committed
May 24, 2023
M
[3.12] gh-104866: Tokenize should emit NEWLINE after exiting block with comment (GH-104870) (#104872)
Miss Islington (bot) committed
May 22, 2023
C
gh-102856: Allow comments inside multi-line f-string expresions (#104006)
Cristián Maureira-Fredes committed
May 21, 2023
S
gh-98836: Extend PyUnicode_FromFormat() (GH-98838)
Serhiy Storchaka committed
M
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías committed
May 20, 2023
P
gh-104658: Fix location of unclosed quote error for multiline f-strings (#104660)
Pablo Galindo Salgado committed
May 8, 2023
H
Trim trailing whitespace and test on CI (#104275)
Hugo van Kemenade committed
May 4, 2023
P
gh-104169: Ensure the tokenizer doesn't overwrite previous errors (#104170)
Pablo Galindo Salgado committed
L
gh-97556: Raise null bytes syntax error upon null in multiline string (GH-104136)
Lysandros Nikolaou committed
May 1, 2023
J
gh-104016: Fixed off by 1 error in f string tokenizer (#104047)
jx124 committed
C
gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)
chgnrdv committed
April 27, 2023
L
gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-103896)
Lysandros Nikolaou committed
April 25, 2023
L
gh-103718: Correctly set f-string buffers in all cases (GH-103815)
Lysandros Nikolaou committed
April 24, 2023
L
GH-103727: Avoid advancing tokenizer too far in f-string mode (GH-103775)
Lysandros Nikolaou committed
April 23, 2023
L
GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)
Lysandros Nikolaou committed
April 19, 2023
P
gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)
Pablo Galindo Salgado committed
P
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado committed
November 30, 2022
P
gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-99893)
Pablo Galindo Salgado committed
November 20, 2022
P
gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill the available buffer (#99605)
Pablo Galindo Salgado committed
November 10, 2022
V
gh-99300: Use Py_NewRef() in Parser/ directory (#99330)
Victor Stinner committed
October 7, 2022
L
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou committed
October 6, 2022
L
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou committed
September 27, 2022
P
gh-96670: Raise SyntaxError when parsing NULL bytes (#97594)
Pablo Galindo Salgado committed
September 13, 2022
M
gh-96678: Fix UB of null pointer arithmetic (GH-96782)
Matthias Görgens committed
September 7, 2022
M
gh-96268: Fix loading invalid UTF-8 (#96270)
Michael Droettboom committed
September 6, 2022
M
gh-96611: Fix error message for invalid UTF-8 in mid-multiline string (#96623)
Michael Droettboom committed
July 5, 2022
P
gh-94360: Fix a tokenizer crash when reading encoded files with syntax errors from stdin (#94386)
Pablo Galindo Salgado committed
June 14, 2022
S
gh-93741: Add private C API _PyImport_GetModuleAttrString() (GH-93742)
Serhiy Storchaka committed
May 27, 2022
K
GH-93207: Remove HAVE_STDARG_PROTOTYPES configure check for stdarg.h (#93215)
Kumar Aditya committed
May 24, 2022
V
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner committed
May 11, 2022
V
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner committed
April 27, 2022
S
gh-87999: Change warning type for numeric literal followed by keyword (GH-91980)
Serhiy Storchaka committed
April 2, 2022
C
bpo-46315: Use fopencookie only on Emscripten 3.x and newer (GH-32266)
Christian Heimes committed
March 30, 2022
H
bpo-47126: Update to canonical PEP URLs specified by PEP 676 (GH-32124)
Hugo van Kemenade committed
March 22, 2022
C
bpo-46315: Use fopencookie() to avoid dup() in _PyTokenizer_FindEncodingFilename (GH-32033)
Christian Heimes committed
March 14, 2022
O
bpo-46920: Remove code that has explainers why it was disabled (GH-31813)
Oleg Iarygin committed
February 22, 2022
S
bpo-46820: Fix a SyntaxError in a numeric literal followed by "not in" (GH-31479)
Serhiy Storchaka committed