Skip to content

gh-128002: use per threads tasks linked list in asyncio #128869

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ambv merged 22 commits into from
Feb 6, 2025
Merged

gh-128002: use per threads tasks linked list in asyncio #128869

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
1a39d41
switch to per thread tasks list
kumaraditya303 Jan 11, 2025
28735e7
traverse linked lists of all threads
kumaraditya303 Jan 12, 2025
3052330
cleanup
kumaraditya303 Jan 14, 2025
acef821
add comments
kumaraditya303 Jan 15, 2025
237a089
add a per interp tasks list
kumaraditya303 Jan 16, 2025
c12f271
fixup for regular builds
kumaraditya303 Jan 16, 2025
d36270f
fix missing start world
kumaraditya303 Jan 16, 2025
f863cd5
Merge branch 'main' of https://github.com/python/cpython into per-thr…
kumaraditya303 Jan 21, 2025
d0fbbc2
add interp llist
kumaraditya303 Jan 21, 2025
5f5b95e
add more tests
kumaraditya303 Jan 21, 2025
708b410
fix test
kumaraditya303 Jan 21, 2025
2c1e93e
try fix compilation
kumaraditya303 Jan 21, 2025
c0ce361
remove supp
kumaraditya303 Jan 21, 2025
aa4c2d1
Merge branch 'main' of https://github.com/python/cpython into per-thr…
kumaraditya303 Jan 24, 2025
fd3fc0b
Merge branch 'main' of https://github.com/python/cpython into per-thr…
kumaraditya303 Jan 24, 2025
c45c9d7
fix merge
kumaraditya303 Jan 24, 2025
f0a9e53
Merge branch 'main' into per-thread-tasks
kumaraditya303 Jan 25, 2025
5b33c45
code review
kumaraditya303 Jan 29, 2025
1d73843
cleanup
kumaraditya303 Jan 29, 2025
4014e70
add comment for asyncio_tasks_lock
kumaraditya303 Jan 29, 2025
83aec26
Reword explanation
ambv Feb 6, 2025
e52741f
Merge branch 'main' into per-thread-tasks
ambv Feb 6, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
cleanup
  • Loading branch information
@kumaraditya303
kumaraditya303 committed Jan 15, 2025
commit 305233018fe4ac478ff811ad0d2c00e95b41993b
2 changes: 1 addition & 1 deletion Include/internal/pycore_lock.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ typedef enum _PyLockFlags {

// Lock a mutex with an optional timeout and additional options. See
// _PyLockFlags for details.
extern PyLockStatus
extern PyAPI_FUNC(PyLockStatus)
_PyMutex_LockTimed(PyMutex *m, PyTime_t timeout_ns, _PyLockFlags flags);

// Lock a mutex with additional options. See _PyLockFlags for details.
Expand Down
8 changes: 4 additions & 4 deletions Modules/_asynciomodule.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3750,9 +3750,9 @@ _asyncio_all_tasks_impl(PyObject *module, PyObject *loop)
struct llist_node *node;
PyInterpreterState *interp = PyInterpreterState_Get();
_PyEval_StopTheWorld(interp);
_PyThreadStateImpl *ts = (_PyThreadStateImpl *)PyInterpreterState_ThreadHead(interp);
while (ts) {
struct llist_node *head = &ts->asyncio_tasks_head;
_Py_FOR_EACH_TSTATE_BEGIN(interp, p) {
_PyThreadStateImpl *tstate = (_PyThreadStateImpl *)p;
struct llist_node *head = &tstate->asyncio_tasks_head;
llist_for_each_safe(node, head) {
TaskObj *task = llist_data(node, TaskObj, task_node);
// The linked list holds borrowed references to task
Expand All @@ -3771,8 +3771,8 @@ _asyncio_all_tasks_impl(PyObject *module, PyObject *loop)
}
}
}
ts = (_PyThreadStateImpl *)ts->base.next;
}
_Py_FOR_EACH_TSTATE_END(interp);
_PyEval_StartTheWorld(interp);
if (err) {
return NULL;
Expand Down