Skip to content

Verbose option ignored when running tests with "-ci" #139208

Closed

Description

@jaraco

Another problem I've noticed: I can pass -v to the test runner and it will give a verbose output of the tests run, but if I pass --fast-ci or --slow-ci, the -v seems to be ignored:

stan@raspberrypi:~/cpython $ ./python -W error -m test --fast-ci test_importlib --dont-add-python-opts -v
== CPython 3.15.0a0 (heads/gh-138313:43357c2, Sep 7 2025, 18:10:29) [GCC 12.2.0]
== Linux-6.12.20+rpt-rpi-v8-aarch64-with-glibc2.36 little-endian
== Python build: release
== cwd: /home/stan/cpython/build/test_python_worker_3504242æ
== CPU count: 4
== encodings: locale=ISO-8859-1 FS=utf-8
== resources: all,-cpu

Using random seed: 27757186
0:00:00 load avg: 0.36 Run 1 test in parallel using 1 worker process (timeout: 10 min, worker timeout: 15 min)
0:00:10 load avg: 0.46 [1/1] test_importlib passed

== Tests result: SUCCESS ==

10 slowest tests:
- test_importlib: 10.5 sec

1 test OK.

Total duration: 10.5 sec
Total tests: run=1,349 skipped=19
Total test files: run=1/1
Result: SUCCESS
stan@raspberrypi:~/cpython $ ./python -W error -m test --slow-ci test_importlib --dont-add-python-opts -v
== CPython 3.15.0a0 (heads/gh-138313:43357c2, Sep 7 2025, 18:10:29) [GCC 12.2.0]
== Linux-6.12.20+rpt-rpi-v8-aarch64-with-glibc2.36 little-endian
== Python build: release
== cwd: /home/stan/cpython/build/test_python_worker_3504340æ
== CPU count: 4
== encodings: locale=ISO-8859-1 FS=utf-8
== resources: all

Using random seed: 958552036
0:00:00 load avg: 0.30 Run 1 test in parallel using 1 worker process (timeout: 20 min, worker timeout: 25 min)
0:00:10 load avg: 0.48 [1/1] test_importlib passed

== Tests result: SUCCESS ==

10 slowest tests:
- test_importlib: 10.4 sec

1 test OK.

Total duration: 10.4 sec
Total tests: run=1,349 skipped=19
Total test files: run=1/1
Result: SUCCESS

So I'm not at all confident on which tests are being run because the test runner is only reporting running one test.

Originally posted by @jaraco in #138313

Linked PRs

Activity

  1. added
    type-bugAn unexpected behavior, bug, or error
    testsTests in the Lib/test dir
    on Sep 21, 2025
  2. AA-Turner commented on Sep 21, 2025

    @AA-Turner
    Member
  3. added 2 commits that reference this issue on Sep 22, 2025
  4. vstinner commented on Sep 22, 2025

    @vstinner
    Member

    I wrote #139240 to fix this behavior.

  5. added a commit that references this issue on Sep 23, 2025
  6. added 2 commits that reference this issue on Sep 23, 2025
  7. vstinner commented on Sep 23, 2025

    @vstinner
    Member

    Fixed. Thanks for your bug report.

  8. added a commit that references this issue on Sep 23, 2025
  9. added a commit that references this issue on Oct 7, 2025
  10. hugovk commented on Oct 8, 2025

    @hugovk
    Member

    Backports merged to all bugfix branches.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    testsTests in the Lib/test dirtype-bugAn unexpected behavior, bug, or error

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions