Morph MORPH
SIGN IN SIGN UP
python / cpython UNCLAIMED

The Python programming language

0 0 13 Python

COMMITS

/ Lib/tokenize.py
d01db1c2a2a71455163a1d3b214cc8dc27201303
May 31, 2017
A
bpo-25324: copy tok_name before changing it (#1608)
Albert-Jan Nijburg committed
fc354f0
May 24, 2017
A
bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607)
Albert-Jan Nijburg committed
c471ca4
May 18, 2017
J
bpo-30296 Remove unnecessary tuples, lists, sets, and dicts (#1489)
Jon Dufresne committed
3972628
March 14, 2017
J
Add ELLIPSIS and RARROW. Add tests (#666)
Jim Fasarakis-Hilliard committed
d4914e9
September 9, 2016
B
Issue #26331: Implement the parsing part of PEP 515.
Brett Cannon committed
a721aba
March 20, 2016
S
Issue #26581: Use the first coding cookie on a line, not the last one.
Serhiy Storchaka committed
a051bf3
S
Issue #26581: Use the first coding cookie on a line, not the last one.
Serhiy Storchaka committed
e431d3c
December 29, 2015
B
Issue #25977: Fix typos in Lib/tokenize.py
Berker Peksag committed
a7161e7
B
Issue #25977: Fix typos in Lib/tokenize.py
Berker Peksag committed
ff8d087
October 26, 2015
E
Issue 25311: Add support for f-strings to tokenize.py. Also added some comments to explain what's happening, since it's not so obvious.
Eric V. Smith committed
1c8222c
July 23, 2015
Y
Issue #24619: Simplify async/await tokenization.
Yury Selivanov committed
96ec934
July 22, 2015
Y
Issue #24619: New approach for tokenizing async/await.
Yury Selivanov committed
8fb307c
June 28, 2015
J
Issue #20387: Merge test and patch from 3.4.4
Jason R. Coombs committed
a95a476
June 22, 2015
D
Issue #20387: Restore retention of indentation during untokenize.
Dingyuan Wang committed
e411b66
May 25, 2015
V
(Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary file
Victor Stinner committed
24d262a
V
Issue #23840: tokenize.open() now closes the temporary binary file on error to
Victor Stinner committed
387729e
May 12, 2015
Y
PEP 0492 -- Coroutines with async and await syntax. Issue #24017.
Yury Selivanov committed
7544508
March 11, 2015
S
Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with
Serhiy Storchaka committed
ca8b644
S
Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with
Serhiy Storchaka committed
cf4a2f2
January 11, 2015
S
Removed duplicated dict entries.
Serhiy Storchaka committed
845b14c
December 5, 2014
V
Issue #22599: Enhance tokenize.open() to be able to call it during Python
Victor Stinner committed
9691750
V
(Merge 3.4) Issue #22599: Enhance tokenize.open() to be able to call it during
Victor Stinner committed
9d279b8
April 10, 2014
B
PEP 465: a dedicated infix operator for matrix multiplication (closes #21176)
Benjamin Peterson committed
d51374e
February 24, 2014
T
Merge with 3.3
Terry Jan Reedy committed
58719a7
T
whitespace
Terry Jan Reedy committed
f106f8f
T
Merge with 3.3
Terry Jan Reedy committed
40f8c67
T
Issue #9974: When untokenizing, use row info to insert backslash+newline.
Terry Jan Reedy committed
9dc3a36
February 18, 2014
T
Merge with 3.3
Terry Jan Reedy committed
79bf899
T
Issue #8478: Untokenizer.compat now processes first token from iterator input.
Terry Jan Reedy committed
5b8d2c3
February 17, 2014
T
Untokenize, bad assert: Merge with 3.3
Terry Jan Reedy committed
8c8d772
T
Untokenize: An logically incorrect assert tested user input validity.
Terry Jan Reedy committed
5e6db31
January 9, 2014
S
Issue #18960: Fix bugs with Python source code encoding in the second line.
Serhiy Storchaka committed
7282ff6
S
Issue #18960: Fix bugs with Python source code encoding in the second line.
Serhiy Storchaka committed
768c16c
November 25, 2013
E
#19620: merge with 3.3.
Ezio Melotti committed
5833c00
E
#19620: Fix typo in docstring (noticed by Christopher Welborn).
Ezio Melotti committed
4bcc796
September 16, 2013
S
Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script
Serhiy Storchaka committed
9353494
S
Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script
Serhiy Storchaka committed
dafea85
December 25, 2012
A
Replace IOError with OSError (#16715)
Andrew Svetlov committed
f7a17b4
November 3, 2012
E
#16152: merge with 3.2.
Ezio Melotti committed
fafa8b7
E
#16152: fix tokenize to ignore whitespace at the end of the code when no newline is found. Patch by Ned Batchelder.
Ezio Melotti committed
2cc3b4b
July 7, 2012
F
Merge branch
Florent Xicluna committed
fed2c51
F
Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding declaration.
Florent Xicluna committed
11f0b41
June 20, 2012
C
Issue #15096: Drop support for the ur string prefix
Christian Heimes committed
0b3847d
June 17, 2012
M
Issue #15054: Fix incorrect tokenization of 'b' string literals.
Meador Inge committed
8d5c0b8
April 20, 2012
B
Issue #14629: Mention the filename in SyntaxError exceptions from
Brett Cannon committed
c33f3f2
M
merge 3.2: issue 14629
Martin v. Löwis committed
63c39fe
M
Issue #14629: Raise SyntaxError in tokenizer.detect_encoding
Martin v. Löwis committed
63674f4
March 4, 2012
A
Updated tokenize to support the inverse byte literals new in 3.3
Armin Ronacher committed
c0eaeca
A
Basic support for PEP 414 without docs or tests.
Armin Ronacher committed
6ecf77b
January 19, 2012
M
Issue #2134: Add support for tokenize.TokenInfo.exact_type.
Meador Inge committed
00c7f85