COMMITS
/ Parser/tokenizer.c May 8, 2023
H
Trim trailing whitespace and test on CI (#104275)
Hugo van Kemenade committed
May 4, 2023
P
gh-104169: Ensure the tokenizer doesn't overwrite previous errors (#104170)
Pablo Galindo Salgado committed
L
gh-97556: Raise null bytes syntax error upon null in multiline string (GH-104136)
Lysandros Nikolaou committed
May 1, 2023
J
gh-104016: Fixed off by 1 error in f string tokenizer (#104047)
jx124 committed
C
gh-103824: fix use-after-free error in Parser/tokenizer.c (#103993)
chgnrdv committed
April 27, 2023
L
gh-103656: Transfer f-string buffers to parser to avoid use-after-free (GH-103896)
Lysandros Nikolaou committed
April 25, 2023
L
gh-103718: Correctly set f-string buffers in all cases (GH-103815)
Lysandros Nikolaou committed
April 24, 2023
L
GH-103727: Avoid advancing tokenizer too far in f-string mode (GH-103775)
Lysandros Nikolaou committed
April 23, 2023
L
GH-103718: Correctly cache and restore f-string buffers when needed (GH-103719)
Lysandros Nikolaou committed
April 19, 2023
P
gh-102856: Clean some of the PEP 701 tokenizer implementation (#103634)
Pablo Galindo Salgado committed
P
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado committed
November 30, 2022
P
gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-99893)
Pablo Galindo Salgado committed
November 20, 2022
P
gh-99581: Fix a buffer overflow in the tokenizer when copying lines that fill the available buffer (#99605)
Pablo Galindo Salgado committed
November 10, 2022
V
gh-99300: Use Py_NewRef() in Parser/ directory (#99330)
Victor Stinner committed
October 7, 2022
L
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou committed
October 6, 2022
L
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou committed
September 27, 2022
P
gh-96670: Raise SyntaxError when parsing NULL bytes (#97594)
Pablo Galindo Salgado committed
September 13, 2022
M
gh-96678: Fix UB of null pointer arithmetic (GH-96782)
Matthias Görgens committed
September 7, 2022
M
gh-96268: Fix loading invalid UTF-8 (#96270)
Michael Droettboom committed
September 6, 2022
M
gh-96611: Fix error message for invalid UTF-8 in mid-multiline string (#96623)
Michael Droettboom committed
July 5, 2022
P
gh-94360: Fix a tokenizer crash when reading encoded files with syntax errors from stdin (#94386)
Pablo Galindo Salgado committed
June 14, 2022
S
gh-93741: Add private C API _PyImport_GetModuleAttrString() (GH-93742)
Serhiy Storchaka committed
May 27, 2022
K
GH-93207: Remove HAVE_STDARG_PROTOTYPES configure check for stdarg.h (#93215)
Kumar Aditya committed
May 24, 2022
V
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner committed
May 11, 2022
V
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner committed
April 27, 2022
S
gh-87999: Change warning type for numeric literal followed by keyword (GH-91980)
Serhiy Storchaka committed
April 2, 2022
C
bpo-46315: Use fopencookie only on Emscripten 3.x and newer (GH-32266)
Christian Heimes committed
March 30, 2022
H
bpo-47126: Update to canonical PEP URLs specified by PEP 676 (GH-32124)
Hugo van Kemenade committed
March 22, 2022
C
bpo-46315: Use fopencookie() to avoid dup() in _PyTokenizer_FindEncodingFilename (GH-32033)
Christian Heimes committed
March 14, 2022
O
bpo-46920: Remove code that has explainers why it was disabled (GH-31813)
Oleg Iarygin committed
February 22, 2022
S
bpo-46820: Fix a SyntaxError in a numeric literal followed by "not in" (GH-31479)
Serhiy Storchaka committed
February 8, 2022
E
P
bpo-46521: Fix codeop to use a new partial-input mode of the parser (GH-31010)
Pablo Galindo Salgado committed
February 1, 2022
P
bpo-14916: use specified tokenizer fd for file input (GH-31006)
Paul m. p. P committed
January 25, 2022
P
bpo-46091: Correctly calculate indentation levels for whitespace lines with continuation characters (GH-30130)
Pablo Galindo Salgado committed
December 12, 2021
K
P
bpo-46054: Fix parsing error when parsing non-utf8 characters in source files (GH-30068)
Pablo Galindo Salgado committed
November 21, 2021
P
Ensure the str member of the tokenizer is always initialised (GH-29681)
Pablo Galindo Salgado committed
November 20, 2021
P
bpo-45811: Improve error message when source code contains invisible control characters (GH-29654)
Pablo Galindo Salgado committed
November 14, 2021
P
bpo-45738: Fix computation of error location for invalid continuation (GH-29550)
Pablo Galindo Salgado committed
October 28, 2021
P
bpo-45562: Ensure all tokenizer debug messages are printed to stderr (GH-29270)
Pablo Galindo Salgado committed
October 27, 2021
P
bpo-45562: Print tokenizer debug messages to stderr (GH-29250)
Pablo Galindo Salgado committed
October 22, 2021
N
bpo-45574: fix warning about `print_escape` being unused (GH-29172)
Nikita Sobolev committed
P
bpo-45562: Only show debug output from the parser in debug builds (GH-29140)
Pablo Galindo Salgado committed
October 13, 2021
V
bpo-45434: Mark the PyTokenizer C API as private (GH-28924)
Victor Stinner committed
October 12, 2021
V
bpo-45439: Move _PyObject_CallNoArgs() to pycore_call.h (GH-28895)
Victor Stinner committed
October 11, 2021
V
bpo-45439: Rename _PyObject_CallNoArg() to _PyObject_CallNoArgs() (GH-28891)
Victor Stinner committed
July 30, 2021
N
Update URLs in comments and metadata to use HTTPS (GH-27458)
Noah Kantrowitz committed
July 10, 2021
P
bpo-44317: Improve tokenizer errors with more informative locations (GH-26555)
Pablo Galindo Salgado committed
June 13, 2021
B
Fix typos in multiple files (GH-26689)
Binbin committed