Skip to content

bpo-29842: Make Executor.map less eager so it handles large/unbounded… #707

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
MojoVampire wants to merge 6 commits into from
Closed

bpo-29842: Make Executor.map less eager so it handles large/unbounded… #707

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
fbdb56c
bpo-29842: Make Executor.map less eager so it handles large/unbounded…
MojoVampire Mar 18, 2017
6281379
Merge branch 'master' into fix-issue-29842
MojoVampire May 6, 2019
8394e34
Add prefetch info to docstrings
MojoVampire May 6, 2019
634a3de
Add Misc/NEWS entry
MojoVampire May 6, 2019
0152831
Remove trailing whitespace in docs
MojoVampire May 6, 2019
3c38fab
Fix behavior to follow test_free_reference requirements (generator ho…
MojoVampire May 6, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add prefetch info to docstrings
  • Loading branch information
@MojoVampire
MojoVampire committed May 6, 2019
commit 8394e3480eb9fbb5200836174024d75581a03b22
2 changes: 2 additions & 0 deletions Lib/concurrent/futures/_base.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -581,6 +581,8 @@ def map(self, fn, *iterables, timeout=None, chunksize=1, prefetch=None):
before being passed to a child process. This argument is only
used by ProcessPoolExecutor; it is ignored by
ThreadPoolExecutor.
prefetch: The number of chunks to queue beyond the number of
workers on the executor. If None, a reasonable default is used.

Returns:
An iterator equivalent to: map(func, *iterables) but the calls may
Expand Down
2 changes: 2 additions & 0 deletions Lib/concurrent/futures/process.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -643,6 +643,8 @@ def map(self, fn, *iterables, timeout=None, chunksize=1, prefetch=None):
chunksize: If greater than one, the iterables will be chopped into
chunks of size chunksize and submitted to the process pool.
If set to one, the items in the list will be sent one at a time.
prefetch: The number of chunks to queue beyond the number of
workers on the executor. If None, a reasonable default is used.

Returns:
An iterator equivalent to: map(func, *iterables) but the calls may
Expand Down