COMMITS
/ Python/Python-tokenize.c June 12, 2024
M
[3.12] gh-120343: Fix column offsets of multiline tokens in tokenize (GH-120391) (#120428)
Miss Islington (bot) committed
June 11, 2024
M
[3.12] gh-120343: Do not reset byte_col_offset_diff after multiline tokens (GH-120352) (#120356)
Miss Islington (bot) committed
May 29, 2024
M
[3.12] gh-119704: Fix reference leak in the ``Python/Python-tokenize.c`` (GH-119705) (#119708)
Miss Islington (bot) committed
May 28, 2024
M
[3.12] gh-119118: Fix performance regression in tokenize module (GH-119615) (#119683)
Miss Islington (bot) committed
December 11, 2023
P
[3.12] gh-112943: Correctly compute end offsets for multiline tokens in the tokenize module (GH-112949) (#112957)
Pablo Galindo Salgado committed
June 9, 2023
M
[3.12] gh-105564: Don't include artificial newlines in the line attribute of tokens (GH-105565) (#105579)
Miss Islington (bot) committed
June 7, 2023
M
[3.12] gh-105390: Add explicit type cast (GH-105466) (#105472)
Miss Islington (bot) committed
M
[3.12] gh-105435: Fix spurious NEWLINE token if file ends with comment without a newline (GH-105442) (#105444)
Miss Islington (bot) committed
M
[3.12] gh-105390: Correctly raise TokenError instead of SyntaxError for tokenize errors (GH-105399) (#105439)
Miss Islington (bot) committed
June 6, 2023
M
[3.12] gh-105259: Ensure we don't show newline characters for trailing NEWLINE tokens (GH-105364) (#105367)
Miss Islington (bot) committed
May 31, 2023
M
[3.12] gh-105069: Add a readline-like callable to the tokenizer to consume input iteratively (GH-105070) (#105119)
Miss Islington (bot) committed
M
[3.12] gh-105042: Disable unmatched parens syntax error in python tokenize (GH-105061) (#105120)
Miss Islington (bot) committed
May 28, 2023
M
[3.12] gh-105017: Include CRLF lines in strings and column numbers (GH-105030) (#105041)
Miss Islington (bot) committed
May 26, 2023
M
[3.12] gh-104976: Ensure trailing dedent tokens are emitted as the previous tokenizer (GH-104980) (#105000)
Miss Islington (bot) committed
M
[3.12] gh-104972: Ensure that line attributes in tokens in the tokenize module are correct (GH-104975) (#104982)
Miss Islington (bot) committed
May 24, 2023
P
[3.12] gh-104825: Remove implicit newline in the line attribute in tokens emitted in the tokenize module (GH-104846). (#104850)
Pablo Galindo Salgado committed
May 22, 2023
M
gh-104741: Add line number attribute to indentation error exception (#104743)
Marta Gómez Macías committed
M
gh-102856: Tokenize performance improvement (#104731)
Marta Gómez Macías committed
May 21, 2023
M
gh-102856: Python tokenizer implementation for PEP 701 (#104323)
Marta Gómez Macías committed
May 5, 2023
E
gh-99113: Add Py_MOD_PER_INTERPRETER_GIL_SUPPORTED (gh-104205)
Eric Snow committed
April 19, 2023
P
gh-102856: Initial implementation of PEP 701 (#102855)
Pablo Galindo Salgado committed
October 6, 2022
L
gh-97973: Return all necessary information from the tokenizer (GH-97984)
Lysandros Nikolaou committed
August 11, 2022
February 11, 2022
P
bpo-46613: Add PyType_GetModuleByDef to the public API (GH-31081)
Petr Viktorin committed
October 13, 2021
V
bpo-45434: Mark the PyTokenizer C API as private (GH-28924)
Victor Stinner committed
October 3, 2021
S
Remove trailing spaces. (GH-28706)
Serhiy Storchaka committed
August 25, 2021
P
Format the Python-tokenize module and fix exit path (GH-27935)
Pablo Galindo Salgado committed
August 24, 2021
P
Add tests for the C tokenizer and expose it as a private module (GH-27924)
Pablo Galindo Salgado committed