Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
535c8b8
Add a "Runtime Components" section to the execution model docs.
ericsnowcurrently Jun 20, 2025
3f3d5cc
Fix a typo.
ericsnowcurrently Jun 27, 2025
b1d6ed7
Clarify about platform support for threads.
ericsnowcurrently Jun 27, 2025
aeca87a
Drop a comment.
ericsnowcurrently Jun 27, 2025
b12a02b
Identify what might be thread-specific state.
ericsnowcurrently Jun 27, 2025
17a2f34
Clarify about "interpreter".
ericsnowcurrently Jun 27, 2025
9ac4b4a
Clarify the relationship betwwen OS threads and Python threads and in…
ericsnowcurrently Jun 27, 2025
f7cb965
Clarify about the host.
ericsnowcurrently Jun 30, 2025
e71394c
Do not talk about distributed computing.
ericsnowcurrently Jun 30, 2025
8f454c4
Note the operating system in the diagram.
ericsnowcurrently Jun 30, 2025
cd0200c
Avoid talking about how threads are scheduled.
ericsnowcurrently Jun 30, 2025
9ccc743
Be more specific about the "pain" of threads.
ericsnowcurrently Jun 30, 2025
4dce0fc
Clarify about the relationship between OS threads, Python threads, an…
ericsnowcurrently Jun 30, 2025
bf1f1a2
Various refactors, incl. drop mention of "OS".
ericsnowcurrently Sep 25, 2025
b58a95c
Drop "call into Python" discussion.
ericsnowcurrently Sep 25, 2025
f05848c
Fix literal block.
ericsnowcurrently Sep 29, 2025
6304a23
Fix Python layers.
ericsnowcurrently Sep 29, 2025
e9c946f
Fix an ambiguous sentance.
ericsnowcurrently Sep 29, 2025
8de5e0a
Fix an ambiguous commit hash.
ericsnowcurrently Sep 29, 2025
b81dbd2
Clarify about thread state independence.
ericsnowcurrently Sep 29, 2025
cd144de
Clarify about multiple thread states per host thread.
ericsnowcurrently Sep 29, 2025
582b924
Clarify about asyncio.
ericsnowcurrently Sep 30, 2025
78e4bbc
Add a link to the commit on github.
ericsnowcurrently Sep 30, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Clarify about the relationship between OS threads, Python threads, an…
…d interpreters.
  • Loading branch information
ericsnowcurrently committed Jun 30, 2025
commit 4dce0fcdfcb855c8771daad83dc5f6923921c288
61 changes: 38 additions & 23 deletions Doc/reference/executionmodel.rst
Original file line number Diff line number Diff line change
Expand Up @@ -453,40 +453,55 @@ specific to Python::

When a Python program starts, it looks exactly like that, with one
of each. The process has a single global runtime to manage Python's
process-global resources. Each Python thread has all the state it needs
to run Python code (and use any supported C-API) in its OS thread.
Depending on the implementation, this probably includes the current
exception and the Python call stack.

In between the global runtime and the thread(s) lies the interpreter.
It completely encapsulates all of the non-process-global runtime state
that the interpreter's Python threads share. For example, all its
threads share :data:`sys.modules`. Every Python thread belongs to a
single interpreter and runs using that shared state. The initial
interpreter is known as the "main" interpreter, and the initial thread,
where the runtime was initialized, is known as the "main" thread.
process-global resources. The runtime may grow to include multiple
interpreters and each interpreter may grow to include multiple Python
threads. The initial interpreter is known as the "main" interpreter,
and the initial thread, where the runtime was initialized, is known
as the "main" thread.

An interpreter completely encapsulates all of the non-process-global
runtime state that the interpreter's Python threads share. For example,
all its threads share :data:`sys.modules`, but each interpreter has its
own :data:`sys.modules`.

.. note::

The interpreter here is not the same as the "bytecode interpreter",
which is what runs in each thread, executing compiled Python code.
which is what regularly runs in threads, executing compiled Python code.

A Python thread represents the state necessary for the Python runtime
to *run* in an OS thread. It also represents the execution of Python
code (or any supported C-API) in that OS thread. Depending on the
implementation, this probably includes the current exception and
the Python call stack. The Python thread always identifies the
interpreter it belongs to, meaning the state it shares
with other threads.

.. note::

Here "Python thread" does not necessarily refer to a thread created
using the :mod:`threading` module.

Each Python thread is associated with a single OS thread, which is where
it can run. In the opposite direction, a single OS thread can have many
Python threads associated with it. However, only one of those Python
threads is "active" in the OS thread at time. The runtime will operate
in the OS thread relative to the active Python thread.

Every Python thread is associated with a single OS thread, which is
where it runs. However, multiple Python threads can be associated with
the same OS thread. For example, an OS thread might run code with a
first interpreter and then with a second, each necessarily with its own
Python thread. Still, regardless of how many are *associated* with
an OS thread, only one Python thread can be actively *running* in
an OS thread at a time. Switching between interpreters means
changing the active Python thread.
For an interpreter to be used in an OS thread, it must have a
corresponding active Python thread. Thus switching between interpreters
means changing the active Python thread. An interpreter can have Python
threads, active or inactive, for as many OS threads as it needs. It may
even have multiple Python threads for the same OS thread, though at most
one can be active at a time.

Once a program is running, new Python threads can be created using the
:mod:`threading` module (on platforms and Python implementations that
support threads). Additional processes can be created using the
:mod:`os`, :mod:`subprocess`, and :mod:`multiprocessing` modules.
You can run coroutines (async) in the main thread using :mod:`asyncio`.
Comment thread
ncoghlan marked this conversation as resolved.
Outdated
Interpreters can be created using the :mod:`concurrent.interpreters`
module.
Interpreters can be created and used with the
:mod:`concurrent.interpreters` module.


.. rubric:: Footnotes
Expand Down