COMMITS
/ Parser/tokenizer.h October 7, 2022
L
gh-97997: Add col_offset field to tokenizer and use that for AST nodes (#98000)
Lysandros Nikolaou committed
October 6, 2022
L
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou committed
May 24, 2022
V
gh-93103: Parser uses PyConfig.parser_debug instead of Py_DebugFlag (#93106)
Victor Stinner committed
May 11, 2022
V
gh-92651: Remove the Include/token.h header file (#92652)
Victor Stinner committed
November 21, 2021
P
Ensure the str member of the tokenizer is always initialised (GH-29681)
Pablo Galindo Salgado committed
October 13, 2021
V
bpo-45434: Mark the PyTokenizer C API as private (GH-28924)
Victor Stinner committed
October 6, 2021
C
Fix typos in the Objects directory (GH-28766)
Christian Clauss committed
August 9, 2021
S
bpo-44854: Remove trailing whitespaces (GH-27689)
Serhiy Storchaka committed
May 22, 2021
P
bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)
Pablo Galindo committed
March 28, 2021
P
bpo-25643: Refactor the C tokenizer into smaller, logical units (GH-25050)
Pablo Galindo committed
March 14, 2021
P
January 19, 2021
P
bpo-42864: Improve error messages regarding unclosed parentheses (GH-24161)
Pablo Galindo committed
January 14, 2021
L
bpo-42827: Fix crash on SyntaxError in multiline expressions (GH-24140)
Lysandros Nikolaou committed
February 28, 2020
A
closes bpo-39721: Fix constness of members of tok_state struct. (GH-18600)
Andy Lester committed
April 13, 2019
P
bpo-36623: Clean parser headers and include files (GH-12253)
Pablo Galindo committed
March 7, 2019
G
bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)
Guido van Rossum committed
March 1, 2019
P
bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)
Pablo Galindo committed
January 31, 2019
G
bpo-35766: Merge typed_ast back into CPython (GH-11645)
Guido van Rossum committed
January 13, 2019
A
bpo-16806: Fix `lineno` and `col_offset` for multi-line string tokens (GH-10021)
Anthony Sottile committed
December 17, 2018
S
bpo-33306: Improve SyntaxError messages for unbalanced parentheses. (GH-6516)
Serhiy Storchaka committed
November 17, 2017
V
tokenizer: Remove unused tabs options (#4422)
Victor Stinner committed
October 6, 2017
J
bpo-30406: Make async and await proper keywords (#1669)
Jelle Zijlstra committed
April 3, 2017
J
Remove obsolete declaration in tokenizer.h (#962)
Jim Fasarakis-Hilliard committed
July 23, 2015
Y
Issue #24619: Simplify async/await tokenization.
Yury Selivanov committed
July 22, 2015
Y
Issue #24619: New approach for tokenizing async/await.
Yury Selivanov committed
May 12, 2015
Y
PEP 0492 -- Coroutines with async and await syntax. Issue #24017.
Yury Selivanov committed
October 19, 2013
S
Issue #1772673: The type of `char*` arguments now changed to `const char*`.
Serhiy Storchaka committed
April 4, 2011
V
Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error.
Victor Stinner committed
V
Issue #10785: Store the filename as Unicode in the Python parser.
Victor Stinner committed
October 29, 2010
G
#10222: fix for overzealous AIX compiler.
Georg Brandl committed
October 16, 2010
V
Issue #9713, #10114: Parser functions (eg. PyParser_ASTFromFile) expects
Victor Stinner committed
October 14, 2010
V
Issue #10095: fp_setreadl() doesn't reopen the file, reuse instead the file
Victor Stinner committed
May 9, 2010
A
Recorded merge of revisions 81029 via svnmerge from
Antoine Pitrou committed
November 13, 2009
B
Merged revisions 76230 via svnmerge from
Benjamin Peterson committed
March 2, 2009
B
ignore the coding cookie in compile(), exec(), and eval() if the source is a string #4626
Benjamin Peterson committed
October 17, 2008
B
Latin-1 source code was not being properly decoded when passed through
Brett Cannon committed
October 22, 2007
G
Issue 1267, continued.
Guido van Rossum committed
October 19, 2007
G
Patch 1267 by Christian Heimes.
Guido van Rossum committed
September 21, 2007
N
Use an enum for decoding_state. It makes the code a little more
Neil Schemenauer committed
September 8, 2007
T
Merged revisions 57778-58052 via svnmerge from
Thomas Wouters committed
September 4, 2007
M
Convert code from sys.stdin.encoding to UTF-8 in
Martin v. Löwis committed
March 1, 2006
M
Patch #1440601: Add col_offset attribute to AST nodes.
Martin v. Löwis committed
M
Remove unused field.
Martin v. Löwis committed
December 11, 2002
M
Constify filenames and scripts. Fixes #651362.
Martin v. Löwis committed
September 3, 2002
M
Ignore encoding declarations inside strings. Fixes #603509.
Martin v. Löwis committed
August 4, 2002
M
Make pgen compile with pydebug. Duplicate normalized names, as it may
Martin v. Löwis committed
M
Patch #534304: Implement phase 1 of PEP 263.
Martin v. Löwis committed
September 1, 2000
G
REMOVED all CWI, CNRI and BeOpen copyright markings.
Guido van Rossum committed
July 9, 2000
T
Nuke all remaining occurrences of Py_PROTO and Py_FPROTO.
Tim Peters committed
June 30, 2000
G
Change copyright notice - 2nd try.
Guido van Rossum committed