Repository navigation
Windows Python cannot handle an early PATH entry containing ".." and python.exe #76638
Description
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee = 'https://github.com/zooba'
closed_at = <Date 2018-05-28.22:14:20.327>
created_at = <Date 2017-12-30.18:58:32.765>
labels = ['3.7', '3.8', 'OS-windows', 'type-crash']
title = 'Windows Python cannot handle an early PATH entry containing ".." and python.exe'
updated_at = <Date 2018-05-28.22:14:20.326>
user = 'https://github.com/mingwandroid'bugs.python.org fields:
activity = <Date 2018-05-28.22:14:20.326>
actor = 'steve.dower'
assignee = 'steve.dower'
closed = True
closed_date = <Date 2018-05-28.22:14:20.327>
closer = 'steve.dower'
components = ['Windows']
creation = <Date 2017-12-30.18:58:32.765>
creator = 'Ray Donnelly'
dependencies = []
files = []
hgrepos = []
issue_num = 32457
keywords = ['patch']
message_count = 8.0
messages = ['309242', '309243', '309249', '309491', '309495', '312579', '312587', '312595']
nosy_count = 7.0
nosy_names = ['paul.moore', 'tim.golden', 'zach.ware', 'eryksun', 'steve.dower', 'Ray Donnelly', 'miss-islington']
pr_nums = ['5756', '5817', '5818']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'crash'
url = 'https://bugs.python.org/issue32457'
versions = ['Python 3.6', 'Python 3.7', 'Python 3.8']
Activity
mingwandroid commentedon Dec 30, 2017
Over on the Anaconda Distribution we received a (private) bug report about a crash when trying to use scons. I thought initially it was due to one of our patches but I tested it out with official CPython and also with WinPython and ran into the same crash.
To reproduce this, from cmd.exe on CPython (here I installed CPython as part of Visual Studio 2017, then updated it to the latest 3.6.4 release):
The trigger for this bug is the following batch code in scons.bat:
https://bitbucket.org/scons/scons/src/c0172db149b1a151eeb76910d55c81746bfede05/src/script/scons.bat?at=default&fileviewer=file-view-default#scons.bat-19
My current thinking is that the best fix here is to modify get_progpath()/get_program_full_path() so that it uses PathCchCanonicalizeEx() at
cpython/PC/getpathp.c
Lines 558 to 559 in 9bee329
mingwandroid commentedon Dec 30, 2017
.. though I will also ask the scons people to change this to use pushd and %CD% instead. Even if you were to make Python capable of handling such bad input, who knows what other programs will fail, and build systems should be extra careful not to mess the environment up like this.
eryksun commentedon Dec 30, 2017
Here's a way to trigger this error that's unrelated to the PATH environment variable:
>>> subprocess.call('python', executable=r'C:\Program Files\Python36\.\python.exe') Fatal Python error: Py_Initialize: unable to load the file system codec ModuleNotFoundError: No module named 'encodings' [...]Apparently Windows doesn't normalize the process image path if it uses only backslash as the path separator. It normalizes it if at least one backslash is replaced with a slash.
zooba commentedon Jan 5, 2018
I agree that explicitly normalizing in PC/getpathp.c is the correct approach.
As far as I'm aware, GetModuleFileNameW(NULL) can never fail other than a buffer that is too small, so that whole function can probably be simplified to abort if it happens and just remove the PATH search.
Also, we should use a similar process for PathCchCanonicalizeEx as we already use for PathCchCombineExW in this file to avoid failing on earlier OS versions.
eryksun commentedon Jan 5, 2018
For extra measure, you may want to normalize
prefixprior to calculating its length n in gotlandmark(). Then it would be reliable to truncate it viaprefix[n] = '\0'after joining withlandmark. Or at least add a comment there or in the calling function, search_for_prefix(), that gotlandmark assumes the current value ofprefixis a canonical, normalized path.zooba commentedon Feb 22, 2018
New changeset 48e8c82 by Steve Dower in branch 'master':
bpo-32457: Improves handling of denormalized executable path when launching Python (GH-5756)
48e8c82
miss-islington commentedon Feb 22, 2018
New changeset e5a9b35 by Miss Islington (bot) in branch '3.7':
bpo-32457: Improves handling of denormalized executable path when launching Python (GH-5756)
e5a9b35
zooba commentedon Feb 22, 2018
New changeset 1d3c518 by Steve Dower in branch '3.6':
bpo-32457: Improves handling of denormalized executable path when launching Python (GH-5756) (bpo-5818)
1d3c518