Repository navigation
lib2to3: support non-ASCII identifiers #78696
Description
| BPO | 34515 |
|---|---|
| Nosy | @benjaminp, @holymonson, @miss-islington |
| PRs |
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee = None
closed_at = <Date 2018-09-15.17:32:33.841>
created_at = <Date 2018-08-27.06:47:47.478>
labels = ['3.8', 'library']
title = 'lib2to3: support non-ASCII identifiers'
updated_at = <Date 2018-09-15.17:53:02.447>
user = 'https://github.com/holymonson'bugs.python.org fields:
activity = <Date 2018-09-15.17:53:02.447>
actor = 'miss-islington'
assignee = 'none'
closed = True
closed_date = <Date 2018-09-15.17:32:33.841>
closer = 'benjamin.peterson'
components = ['Library (Lib)']
creation = <Date 2018-08-27.06:47:47.478>
creator = 'monson'
dependencies = []
files = []
hgrepos = []
issue_num = 34515
keywords = ['patch']
message_count = 3.0
messages = ['324148', '325451', '325452']
nosy_count = 3.0
nosy_names = ['benjamin.peterson', 'monson', 'miss-islington']
pr_nums = ['8950', '9333']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue34515'
versions = ['Python 3.8']
Activity
holymonson commentedon Aug 27, 2018
Python 3.0 introduces additional characters from outside the ASCII range (see PEP-3131). see https://docs.python.org/3/reference/lexical_analysis.html#identifiers
But lib2to3 can't tokenize them corretly.
'中' should be tokenized as NAME instead of ERRORTOKEN.
benjaminp commentedon Sep 15, 2018
New changeset 10a428b by Benjamin Peterson (Monson Shao) in branch 'master':
closes bpo-34515: Support non-ASCII identifiers in lib2to3. (GH-8950)
10a428b
miss-islington commentedon Sep 15, 2018
New changeset 51dbae8 by Miss Islington (bot) in branch '3.7':
closes bpo-34515: Support non-ASCII identifiers in lib2to3. (GH-8950)
51dbae8