Skip to content

gh-89727: Fix os.walk to handle late editing of dirs #100703

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
jonburdo wants to merge 14 commits into from
Closed

gh-89727: Fix os.walk to handle late editing of dirs #100703

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
2767f70
adopt old os.walk behavior to handle changes to dirs list after itera…
jonburdo Jan 3, 2023
04a16a2
move stack logic to bottom of loop in os.walk
jonburdo Jan 3, 2023
6b0465f
move scandir logic to bottom of loop
jonburdo Jan 3, 2023
2ff800f
use for-loop to process dirs in bottom-up clause
jonburdo Jan 3, 2023
072bdfb
Merge branch 'main' into os-walk-dirs-editing
jonburdo Jan 3, 2023
41d7463
return if scandir_it fails on first value
jonburdo Jan 3, 2023
d81ff45
add test for late modification of dirs in os.walk
jonburdo Jan 3, 2023
431d47a
Merge branch 'main' into os-walk-dirs-editing
jonburdo Jan 3, 2023
2829a7d
use while-else instead of while True, make variable names clearer
jonburdo Jan 3, 2023
b59358b
change os.walk docstring to say "traverse" instead of "recurse"
jonburdo Jan 3, 2023
839f31e
fix scandir comment
jonburdo Jan 4, 2023
1011e19
Merge branch 'main' into os-walk-dirs-editing
jonburdo Jan 4, 2023
80b7e82
split topdown and bottomup logic into separate functions for os.walk
jonburdo Jan 4, 2023
70cb0c2
Merge branch 'main' into os-walk-dirs-editing
erlend-aasland Jan 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix scandir comment
  • Loading branch information
@jonburdo
jonburdo committed Jan 4, 2023
commit 839f31eb34e5ecc4ddf5cb0060487483fb788513
11 changes: 6 additions & 5 deletions Lib/os.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -342,6 +342,12 @@ def walk(top, topdown=True, onerror=None, followlinks=False):
sys.audit("os.walk", top, topdown, onerror, followlinks)

top = fspath(top)

# We may not have read permission for top, in which case we can't
# get a list of the files the directory contains.
# We suppress the exception here, rather than blow up for a
# minor reason when (say) a thousand readable directories are still
# left to visit.
try:
scandir_it = scandir(top)
except OSError as error:
Expand All @@ -357,11 +363,6 @@ def walk(top, topdown=True, onerror=None, followlinks=False):
walk_dirs = []
use_entry = True

# We may not have read permission for top, in which case we can't
# get a list of the files the directory contains.
# We suppress the exception here, rather than blow up for a
# minor reason when (say) a thousand readable directories are still
# left to visit.
with scandir_it:
while True:
try:
Expand Down