Skip to content

FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) #117166

Closed

Description

@furkanonder

Bug description:

Configuration:

./configure --with-pydebug

Test:

./python -m test test_tools --junit-xml test-resuls.xml -j2 --timeout 1200 -v

Output:

FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_lib2to3')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/arf/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
    self.assertIn(
    ~~~~~~~~~~~~~^
        relpath,
        ^^^^^^^^
    ...<4 lines>...
        )
        ^
    )
    ^
AssertionError: 'test/test_lib2to3' not found in ['idlelib/idle_test', 'test', 'test/archivetestdata', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/configdata', 'test/crashers', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/leakers', 'test/libregrtest', 'test/mathdata', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/support/interpreters', 'test/test_asyncio', 'test/test_capi', 'test/test_cext', 'test/test_concurrent_futures', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/metadata', 'test/test_importlib/metadata/data', 'test/test_importlib/metadata/data/sources', 'test/test_importlib/metadata/data/sources/example', 'test/test_importlib/metadata/data/sources/example/example', 'test/test_importlib/metadata/data/sources/example2', 'test/test_importlib/metadata/data/sources/example2/example2', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_inspect', 'test/test_interpreters', 'test/test_json', 'test/test_module', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn', 'test/test_pathlib', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tkinterdata', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20'] : 'test/test_lib2to3' is not included in the Makefile's list of test directories to install

CPython versions tested on:

CPython main branch

Operating systems tested on:

Linux

Linked PRs

Activity

  1. serhiy-storchaka commented on Mar 22, 2024

    @serhiy-storchaka
    Member

    I get another failure:

    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/.ruff_cache/0.1.7')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/serhiy/py/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
        ~~~~~~~~~~~~~^
            relpath,
            ^^^^^^^^
        ...<4 lines>...
            )
            ^
        )
        ^
    AssertionError: 'test/.ruff_cache/0.1.7' not found in ['idlelib/idle_test', 'test', 'test/archivetestdata', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/configdata', 'test/crashers', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/leakers', 'test/libregrtest', 'test/mathdata', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/support/interpreters', 'test/test_asyncio', 'test/test_capi', 'test/test_cext', 'test/test_concurrent_futures', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/metadata', 'test/test_importlib/metadata/data', 'test/test_importlib/metadata/data/sources', 'test/test_importlib/metadata/data/sources/example', 'test/test_importlib/metadata/data/sources/example/example', 'test/test_importlib/metadata/data/sources/example2', 'test/test_importlib/metadata/data/sources/example2/example2', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_inspect', 'test/test_interpreters', 'test/test_json', 'test/test_module', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn', 'test/test_pathlib', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tkinterdata', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20'] : 'test/.ruff_cache/0.1.7' is not included in the Makefile's list of test directories to install
    

    cc @sobolevn

  2. sobolevn commented on Mar 22, 2024

    @sobolevn
    Member

    Thanks, fixing!

  3. self-assigned this
    on Mar 22, 2024
  4. sobolevn commented on Mar 23, 2024

    @sobolevn
    Member

    I can reprode @serhiy-storchaka's failure (by installing ruff in that folder).
    But, how did you get test_lib2to3 in main, @furkanonder ? 🤔

  5. sobolevn commented on Mar 23, 2024

    @sobolevn
    Member

    Basically, my fix is: ignore empty folders and ignore folders that start with .

  6. serhiy-storchaka commented on Mar 23, 2024

    @serhiy-storchaka
    Member

    I guess that @furkanonder has some dot-files or temporary or backup files (ending with ~ or like) in test_lib2to3 or its subdirectories. When the content of test_lib2to3 was deleted in main, the directory was kept because it contains some files not managed by Git.

  7. added a commit that references this issue on Mar 24, 2024
  8. furkanonder commented on Mar 25, 2024

    @furkanonder
    ContributorAuthor

    I can reprode @serhiy-storchaka's failure (by installing ruff in that folder). But, how did you get test_lib2to3 in main, @furkanonder ? 🤔

    Actually, I am not sure how the error happened. This issue occurred in the scenario where running buildbot. Perhaps that occurred while the buildbot was changing the branch. (I'm not sure if the branch is changing; I'm quite new to buildbots).

    The directory structure of buildbot looks like this:

    ubuntu@ubuntu:~/buildarea$ ls -lah
    total 2.1M
    drwxrwxr-x  8 ubuntu ubuntu 4.0K Mar 20 09:22 .
    drwxr-x--- 13 ubuntu ubuntu 4.0K Mar 25 12:53 ..
    drwx------  3 ubuntu ubuntu 4.0K Mar 20 10:40 3.11.onder-riscv64
    drwx------  3 ubuntu ubuntu 4.0K Mar 20 09:23 3.12.onder-riscv64
    drwx------  3 ubuntu ubuntu 4.0K Mar 20 10:43 3.x.onder-riscv64
    -rw-------  1 ubuntu ubuntu 1.5K Mar 20 09:21 buildbot.tac
    drwx------  2 ubuntu ubuntu 4.0K Mar 20 09:22 custom.onder-riscv64
    drwxrwxr-x  2 ubuntu ubuntu 4.0K Mar 20 16:44 info
    drwx------  2 ubuntu ubuntu 4.0K Mar 20 09:22 pull_request.onder-riscv64
    -rw-------  1 ubuntu ubuntu    7 Mar 20 09:22 twistd.hostname
    -rw-rw-r--  1 ubuntu ubuntu 2.0M Mar 25 15:03 twistd.log
    -rw-------  1 ubuntu ubuntu    4 Mar 20 09:22 twistd.pid
  9. serhiy-storchaka commented on Mar 25, 2024

    @serhiy-storchaka
    Member

    What is the content of the test/test_lib2to3 directory and its subdirectories?

  10. furkanonder commented on Mar 25, 2024

    @furkanonder
    ContributorAuthor

    What is the content of the test/test_lib2to3 directory and its subdirectories?

    I ran the test again, there was no problem with 'test/test_lib2to3. There are issues with different directories.

    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_interpreters')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/test_interpreters' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/test_interpreters' is not included in the Makefile's list of test directories to install
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/support/interpreters')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/support/interpreters' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/support/interpreters' is not included in the Makefile's list of test directories to install
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_pathlib')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/test_pathlib' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/test_pathlib' is not included in the Makefile's list of test directories to install
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_cext')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/test_cext' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/test_cext' is not included in the Makefile's list of test directories to install
    
    ----------------------------------------------------------------------
    Ran 37 tests in 24.203s
    
    FAILED (failures=4, skipped=1)
    test test_tools failed
    
    == Tests result: FAILURE ==
    
    1 test failed:
        test_tools
    
    Total duration: 26.8 sec
    Total tests: run=37 failures=4 skipped=1
    Total test files: run=1/1 failed=1
    Result: FAILURE
    ubuntu@ubuntu:~/cpython$ ls -la Lib/test/test_interpreters
    total 24
    drwxrwxr-x  2 ubuntu ubuntu  4096 Mar 22 21:50 .
    drwxrwxr-x 58 ubuntu ubuntu 20480 Mar 24 00:41 ..
    ubuntu@ubuntu:~/cpython$ ls -la Lib/test/support/interpreters
    total 8
    drwxrwxr-x 2 ubuntu ubuntu 4096 Mar 22 21:50 .
    drwxrwxr-x 5 ubuntu ubuntu 4096 Mar 23 22:22 ..
    ubuntu@ubuntu:~/cpython$ ls -la Lib/test/test_pathlib
    total 24
    drwxrwxr-x  2 ubuntu ubuntu  4096 Mar 22 21:50 .
    drwxrwxr-x 58 ubuntu ubuntu 20480 Mar 24 00:41 ..
    ubuntu@ubuntu:~/cpython$ ls -la Lib/test/test_cext/
    total 24
    drwxrwxr-x  2 ubuntu ubuntu  4096 Mar 22 21:50 .
    drwxrwxr-x 58 ubuntu ubuntu 20480 Mar 24 00:41 ..
    ubuntu@ubuntu:~/cpython$
  11. sobolevn commented on Mar 25, 2024

    @sobolevn
    Member

    @furkanonder how can I reproduce this locally? 🤔

  12. furkanonder commented on Mar 25, 2024

    @furkanonder
    ContributorAuthor

    From FreeBSD 13.2-RELEASE-p10 aarch64;

    [freebsd@generic ~/cpython]$ ./python -m test test_tools
    Using random seed: 988355807
    0:00:00 load avg: 0.26 Run 1 test sequentially
    0:00:00 load avg: 0.26 [1/1] test_tools
    test test_tools failed -- Traceback (most recent call last):
      File "/home/freebsd/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
        ~~~~~~~~~~~~~^
            relpath,
            ^^^^^^^^
        ...<4 lines>...
            )
            ^
        )
        ^
    AssertionError: 'test/test_importlib/data' not found in ['idlelib/idle_test', 'test', 'test/archivetestdata', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/configdata', 'test/crashers', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/leakers', 'test/libregrtest', 'test/mathdata', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/support/interpreters', 'test/test_asyncio', 'test/test_capi', 'test/test_cext', 'test/test_concurrent_futures', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/metadata', 'test/test_importlib/metadata/data', 'test/test_importlib/metadata/data/sources', 'test/test_importlib/metadata/data/sources/example', 'test/test_importlib/metadata/data/sources/example/example', 'test/test_importlib/metadata/data/sources/example2', 'test/test_importlib/metadata/data/sources/example2/example2', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_inspect', 'test/test_interpreters', 'test/test_json', 'test/test_module', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn', 'test/test_pathlib', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tkinterdata', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20'] : 'test/test_importlib/data' is not included in the Makefile's list of test directories to install
    
    test_tools failed (1 failure) in 42.1 sec
    
    == Tests result: FAILURE ==
    
    1 test failed:
        test_tools
    
    Total duration: 42.2 sec
    Total tests: run=40 failures=1 skipped=1
    Total test files: run=1/1 failed=1
    Result: FAILURE
    [freebsd@generic ~/cpython]$ 
    
  13. furkanonder commented on Mar 25, 2024

    @furkanonder
    ContributorAuthor

    @furkanonder how can I reproduce this locally? 🤔

    Unfortunately I don't know the exact way, all I did was clone the repository, compile and test it.

  14. sobolevn commented on Mar 25, 2024

    @sobolevn
    Member

    But, these directories does not exit:

    » ls Lib/test/test_importlib/data
    gls: cannot access 'Lib/test/test_importlib/data': No such file or directory
    
    » ls Lib/test/test_lib2to3
    gls: cannot access 'Lib/test/test_lib2to3': No such file or directory
    

    while multiple others are clearly listed, like test/test_cext

    🤔

  15. furkanonder commented on Mar 25, 2024

    @furkanonder
    ContributorAuthor

    From FreeBSD 13.2-RELEASE-p10 aarch64;

    [freebsd@generic ~/cpython]$ ./python -m test test_tools
    Using random seed: 988355807
    0:00:00 load avg: 0.26 Run 1 test sequentially
    0:00:00 load avg: 0.26 [1/1] test_tools
    test test_tools failed -- Traceback (most recent call last):
      File "/home/freebsd/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
        ~~~~~~~~~~~~~^
            relpath,
            ^^^^^^^^
        ...<4 lines>...
            )
            ^
        )
        ^
    AssertionError: 'test/test_importlib/data' not found in ['idlelib/idle_test', 'test', 'test/archivetestdata', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/configdata', 'test/crashers', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/leakers', 'test/libregrtest', 'test/mathdata', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/support/interpreters', 'test/test_asyncio', 'test/test_capi', 'test/test_cext', 'test/test_concurrent_futures', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/metadata', 'test/test_importlib/metadata/data', 'test/test_importlib/metadata/data/sources', 'test/test_importlib/metadata/data/sources/example', 'test/test_importlib/metadata/data/sources/example/example', 'test/test_importlib/metadata/data/sources/example2', 'test/test_importlib/metadata/data/sources/example2/example2', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_inspect', 'test/test_interpreters', 'test/test_json', 'test/test_module', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn', 'test/test_pathlib', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tkinterdata', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20'] : 'test/test_importlib/data' is not included in the Makefile's list of test directories to install
    
    test_tools failed (1 failure) in 42.1 sec
    
    == Tests result: FAILURE ==
    
    1 test failed:
        test_tools
    
    Total duration: 42.2 sec
    Total tests: run=40 failures=1 skipped=1
    Total test files: run=1/1 failed=1
    Result: FAILURE
    [freebsd@generic ~/cpython]$ 
    

    @sobolevn It is here.

    [freebsd@generic ~/cpython]$ ls -la Lib/test/test_importlib/data
    total 8
    drwxr-xr-x   2 freebsd  freebsd   512 Apr 23 01:12 .
    drwxr-xr-x  13 freebsd  freebsd  1024 Apr 25 19:03 ..
    [freebsd@generic ~/cpython]$ 
    
  16. sobolevn commented on Mar 26, 2024

    @sobolevn
    Member

    @furkanonder can you please share more info? main version does not have these directories. It is a fact.

    So, for some reason this buildbot show directories that are not present. This might happen because git saves these directories. Or it might be there for other reasons.

    Can you please run git branch && git log on this machine?

  17. serhiy-storchaka commented on Mar 26, 2024

    @serhiy-storchaka
    Member

    I get now a failure for test/test_importlib/data. This directory only contains the __pycache__ subdirectory. Most likely it is the same in other cases, so with my suggestions #117190 should fix the issue.

  18. sobolevn commented on Mar 26, 2024

    @sobolevn
    Member

    Thanks! I just want to make sure that I am able to reproduce all the corner cases 👍

  19. furkanonder commented on Mar 26, 2024

    @furkanonder
    ContributorAuthor

    @furkanonder can you please share more info? main version does not have these directories. It is a fact.

    So, for some reason this buildbot show directories that are not present. This might happen because git saves these directories. Or it might be there for other reasons.

    Can you please run git branch && git log on this machine?

    ubuntu@ubuntu:~/cpython$ ./python -m test test_tools --junit-xml test-resuls.xml -j12 --timeout 1200 -v
    == CPython 3.12.2+ (heads/3.12:932194dc00, Mar 26 2024, 20:34:17) [GCC 13.2.0]
    == Linux-6.5.0-26-generic-riscv64-with-glibc2.38 little-endian
    == Python build: debug
    == cwd: /home/ubuntu/cpython/build/test_python_worker_3102785æ
    == CPU count: 4
    == encodings: locale=UTF-8 FS=utf-8
    == resources: all test resources are disabled, use -u option to unskip tests
    
    Using random seed: 2572924867
    0:00:00 load avg: 4.09 Run 1 test in parallel using 1 worker process (timeout: 20 min, worker timeout: 25 min)
    0:00:29 load avg: 4.45 [1/1/1] test_tools failed (4 failures)
    test_freeze_simple_script (test.test_tools.test_freeze.TestFreeze.test_freeze_simple_script) ... skipped "resource 'cpu' is not enabled"
    test_POT_Creation_Date (test.test_tools.test_i18n.Test_pygettext.test_POT_Creation_Date)
    Match the date format from xgettext for POT-Creation-Date ... ok
    test_calls_in_fstring_with_keyword_args (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstring_with_keyword_args) ... ok
    test_calls_in_fstring_with_multiple_args (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstring_with_multiple_args) ... ok
    test_calls_in_fstring_with_partially_wrong_expression (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstring_with_partially_wrong_expression) ... ok
    test_calls_in_fstrings (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings) ... ok
    test_calls_in_fstrings_attribute (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_attribute) ... ok
    test_calls_in_fstrings_nested (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_nested) ... ok
    test_calls_in_fstrings_raw (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_raw) ... ok
    test_calls_in_fstrings_with_call_on_call (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_with_call_on_call) ... ok
    test_calls_in_fstrings_with_format (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_with_format) ... ok
    test_calls_in_fstrings_with_wrong_input_1 (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_with_wrong_input_1) ... ok
    test_calls_in_fstrings_with_wrong_input_2 (test.test_tools.test_i18n.Test_pygettext.test_calls_in_fstrings_with_wrong_input_2) ... ok
    test_classdocstring (test.test_tools.test_i18n.Test_pygettext.test_classdocstring) ... ok
    test_classdocstring_bytes (test.test_tools.test_i18n.Test_pygettext.test_classdocstring_bytes) ... ok
    test_classdocstring_early_colon (test.test_tools.test_i18n.Test_pygettext.test_classdocstring_early_colon)
    Test docstring extraction for a class with colons occurring within ... ok
    test_classdocstring_fstring (test.test_tools.test_i18n.Test_pygettext.test_classdocstring_fstring) ... ok
    test_files_list (test.test_tools.test_i18n.Test_pygettext.test_files_list)
    Make sure the directories are inspected for source files ... ok
    test_funcdocstring (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring) ... ok
    test_funcdocstring_annotated_args (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring_annotated_args)
    Test docstrings for functions with annotated args ... ok
    test_funcdocstring_annotated_return (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring_annotated_return)
    Test docstrings for functions with annotated return type ... ok
    test_funcdocstring_bytes (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring_bytes) ... ok
    test_funcdocstring_defvalue_args (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring_defvalue_args)
    Test docstring for functions with default arg values ... ok
    test_funcdocstring_fstring (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring_fstring) ... ok
    test_funcdocstring_multiple_funcs (test.test_tools.test_i18n.Test_pygettext.test_funcdocstring_multiple_funcs)
    Test docstring extraction for multiple functions combining ... ok
    test_header (test.test_tools.test_i18n.Test_pygettext.test_header)
    Make sure the required fields are in the header, according to: ... ok
    test_moduledocstring (test.test_tools.test_i18n.Test_pygettext.test_moduledocstring) ... ok
    test_moduledocstring_bytes (test.test_tools.test_i18n.Test_pygettext.test_moduledocstring_bytes) ... ok
    test_moduledocstring_fstring (test.test_tools.test_i18n.Test_pygettext.test_moduledocstring_fstring) ... ok
    test_msgid (test.test_tools.test_i18n.Test_pygettext.test_msgid) ... ok
    test_msgid_bytes (test.test_tools.test_i18n.Test_pygettext.test_msgid_bytes) ... ok
    test_msgid_fstring (test.test_tools.test_i18n.Test_pygettext.test_msgid_fstring) ... ok
    test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) ... 
      test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_interpreters') ... FAIL
      test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/support/interpreters') ... FAIL
      test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_pathlib') ... FAIL
      test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_cext') ... FAIL
    test_help (test.test_tools.test_reindent.ReindentTests.test_help) ... ok
    test_noargs (test.test_tools.test_reindent.ReindentTests.test_noargs) ... ok
    test_reindent_file_with_bad_encoding (test.test_tools.test_reindent.ReindentTests.test_reindent_file_with_bad_encoding) ... ok
    test_sundry (test.test_tools.test_sundry.TestSundryScripts.test_sundry) ... ok
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_interpreters')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/test_interpreters' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/test_interpreters' is not included in the Makefile's list of test directories to install
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/support/interpreters')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/support/interpreters' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/support/interpreters' is not included in the Makefile's list of test directories to install
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_pathlib')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/test_pathlib' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/test_pathlib' is not included in the Makefile's list of test directories to install
    
    ======================================================================
    FAIL: test_makefile_test_folders (test.test_tools.test_makefile.TestMakefile.test_makefile_test_folders) (relpath='test/test_cext')
    ----------------------------------------------------------------------
    Traceback (most recent call last):
      File "/home/ubuntu/cpython/Lib/test/test_tools/test_makefile.py", line 51, in test_makefile_test_folders
        self.assertIn(
    AssertionError: 'test/test_cext' not found in ['idlelib/idle_test', 'test', 'test/audiodata', 'test/certdata', 'test/certdata/capath', 'test/cjkencodings', 'test/crashers', 'test/configdata', 'test/data', 'test/decimaltestdata', 'test/dtracedata', 'test/encoded_modules', 'test/imghdrdata', 'test/leakers', 'test/libregrtest', 'test/regrtestdata', 'test/regrtestdata/import_from_tests', 'test/regrtestdata/import_from_tests/test_regrtest_b', 'test/sndhdrdata', 'test/subprocessdata', 'test/support', 'test/support/_hypothesis_stubs', 'test/test_asyncio', 'test/test_capi', 'test/test_cppext', 'test/test_ctypes', 'test/test_dataclasses', 'test/test_doctest', 'test/test_email', 'test/test_email/data', 'test/test_future_stmt', 'test/test_gdb', 'test/test_inspect', 'test/test_import', 'test/test_import/data', 'test/test_import/data/circular_imports', 'test/test_import/data/circular_imports/subpkg', 'test/test_import/data/circular_imports/subpkg2', 'test/test_import/data/circular_imports/subpkg2/parent', 'test/test_import/data/package', 'test/test_import/data/package2', 'test/test_import/data/unwritable', 'test/test_importlib', 'test/test_importlib/builtin', 'test/test_importlib/data', 'test/test_importlib/extension', 'test/test_importlib/frozen', 'test/test_importlib/import_', 'test/test_importlib/namespace_pkgs', 'test/test_importlib/namespace_pkgs/both_portions', 'test/test_importlib/namespace_pkgs/both_portions/foo', 'test/test_importlib/namespace_pkgs/module_and_namespace_package', 'test/test_importlib/namespace_pkgs/module_and_namespace_package/a_test', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg', 'test/test_importlib/namespace_pkgs/not_a_namespace_pkg/foo', 'test/test_importlib/namespace_pkgs/portion1', 'test/test_importlib/namespace_pkgs/portion1/foo', 'test/test_importlib/namespace_pkgs/portion2', 'test/test_importlib/namespace_pkgs/portion2/foo', 'test/test_importlib/namespace_pkgs/project1', 'test/test_importlib/namespace_pkgs/project1/parent', 'test/test_importlib/namespace_pkgs/project1/parent/child', 'test/test_importlib/namespace_pkgs/project2', 'test/test_importlib/namespace_pkgs/project2/parent', 'test/test_importlib/namespace_pkgs/project2/parent/child', 'test/test_importlib/namespace_pkgs/project3', 'test/test_importlib/namespace_pkgs/project3/parent', 'test/test_importlib/namespace_pkgs/project3/parent/child', 'test/test_importlib/partial', 'test/test_importlib/resources', 'test/test_importlib/resources/data01', 'test/test_importlib/resources/data01/subdirectory', 'test/test_importlib/resources/data02', 'test/test_importlib/resources/data02/one', 'test/test_importlib/resources/data02/subdirectory', 'test/test_importlib/resources/data02/subdirectory/subsubdir', 'test/test_importlib/resources/data02/two', 'test/test_importlib/resources/data03', 'test/test_importlib/resources/data03/namespace', 'test/test_importlib/resources/data03/namespace/portion1', 'test/test_importlib/resources/data03/namespace/portion2', 'test/test_importlib/resources/namespacedata01', 'test/test_importlib/resources/zipdata01', 'test/test_importlib/resources/zipdata02', 'test/test_importlib/source', 'test/test_json', 'test/test_lib2to3', 'test/test_lib2to3/data', 'test/test_lib2to3/data/fixers', 'test/test_lib2to3/data/fixers/myfixes', 'test/test_module', 'test/test_peg_generator', 'test/test_pydoc', 'test/test_sqlite3', 'test/test_tkinter', 'test/test_tomllib', 'test/test_tomllib/data', 'test/test_tomllib/data/invalid', 'test/test_tomllib/data/invalid/array', 'test/test_tomllib/data/invalid/array-of-tables', 'test/test_tomllib/data/invalid/boolean', 'test/test_tomllib/data/invalid/dates-and-times', 'test/test_tomllib/data/invalid/dotted-keys', 'test/test_tomllib/data/invalid/inline-table', 'test/test_tomllib/data/invalid/keys-and-vals', 'test/test_tomllib/data/invalid/literal-str', 'test/test_tomllib/data/invalid/multiline-basic-str', 'test/test_tomllib/data/invalid/multiline-literal-str', 'test/test_tomllib/data/invalid/table', 'test/test_tomllib/data/valid', 'test/test_tomllib/data/valid/array', 'test/test_tomllib/data/valid/dates-and-times', 'test/test_tomllib/data/valid/multiline-basic-str', 'test/test_tools', 'test/test_ttk', 'test/test_unittest', 'test/test_unittest/testmock', 'test/test_warnings', 'test/test_warnings/data', 'test/test_zipfile', 'test/test_zipfile/_path', 'test/test_zoneinfo', 'test/test_zoneinfo/data', 'test/tokenizedata', 'test/tracedmodules', 'test/typinganndata', 'test/wheeldata', 'test/xmltestdata', 'test/xmltestdata/c14n-20', 'test/ziptestdata', 'test/test_concurrent_futures', 'test/test_multiprocessing_fork', 'test/test_multiprocessing_forkserver', 'test/test_multiprocessing_spawn'] : 'test/test_cext' is not included in the Makefile's list of test directories to install
    
    ----------------------------------------------------------------------
    Ran 37 tests in 25.700s
    
    FAILED (failures=4, skipped=1)
    test test_tools failed
    
    == Tests result: FAILURE ==
    
    1 test failed:
        test_tools
    
    Total duration: 29.5 sec
    Total tests: run=37 failures=4 skipped=1
    Total test files: run=1/1 failed=1
    Result: FAILURE
    ubuntu@ubuntu:~/cpython$ git log
    commit 932194dc0009ef528f19c2d9dedda196533d55d0 (HEAD -> 3.12, origin/3.12)
    Author: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
    Date:   Tue Mar 26 20:14:20 2024 +0100
    
        [3.12] Change links on the index page (GH-117230) (#117268)
        
        Co-authored-by: Adorilson Bezerra <adorilson@gmail.com>
    
    commit ca0793980b90a6a0f9a91f1a5303a1f27b235f83
    Author: AN Long <aisk@users.noreply.github.com>
    Date:   Wed Mar 27 00:53:37 2024 +0800
    
        [3.12] gh-115538: Use isolate mode when running venv test_multiproces… (#117264)
        
        [3.12] gh-115538: Use isolate mode when running venv test_multiprocessing_recursion() (GH-117116)
        (cherry picked from commit 4ec347760f98b156c6a2d42ca397af6b0b6ecc50)
        
        Co-authored-by: Victor Stinner <vstinner@python.org>
    
    commit 0b95ba0306b4a748de38c728a1406fa0df20eea9
    Author: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
    Date:   Tue Mar 26 15:12:36 2024 +0100
    
        [3.12] pre-commit: add `check-case-conflict` and `check-merge-conflict` (GH-117259) (#117260)
        
        Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
    
    commit 36b1a208511532bfdc633fc823fce694ec082e59
    Author: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
    Date:   Tue Mar 26 12:43:36 2024 +0100
    
        [3.12] gh-66543: Fix mimetype.guess_type() (GH-117217) (GH-117256)
        
        Fix parsing of the following corner cases:
        
        * URLs with only a host name
        * URLs containing a fragment
        * URLs containing a query
        * filenames with only a UNC sharepoint on Windows
        
        (cherry picked from commit 9654daf793b534b44a831c80f43505ab9e380f1f)
        
        Co-authored-by: Serhiy Storchaka <storchaka@gmail.com>
        Co-authored-by: Dong-hee Na <donghee.na92@gmail.com>
    
    commit 54514467c26c657eb1a6f8885786297979689d2d
    Author: Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com>
    Date:   Tue Mar 26 10:37:41 2024 +0100
    
        [3.12] gh-83845: Add tests for operator module (GH-115883) (#117253)
        
        Co-authored-by: Hugo van Kemenade <1324225+hugovk@users.noreply.github.com>
        Co-authored-by: Karthikeyan Singaravelan <tir.karthi@gmail.com>
    
    commit 477ef9015c312725734c4613b5ba12e80d920a22
  20. sobolevn commented on Mar 26, 2024

    @sobolevn
    Member

    Thanks! 👍

  21. added a commit that references this issue on Mar 29, 2024
  22. added a commit that references this issue on Mar 29, 2024
  23. added a commit that references this issue on Apr 3, 2024
  24. encukou commented on Apr 3, 2024

    @encukou
    Member

    Thank you for the report and fix!

  25. added a commit that references this issue on Apr 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

testsTests in the Lib/test dirtype-bugAn unexpected behavior, bug, or error

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions