Skip to content

FreeBSD: Fatal Python error: get_locale_encoding: failed to get the locale encoding: nl_langinfo(CODESET) failed #78725

Closed
Closed
FreeBSD: Fatal Python error: get_locale_encoding: failed to get the locale encoding: nl_langinfo(CODESET) failed#78725
Labels
3.8 (EOL)end of lifeinterpreter-core(Objects, Python, Grammar, and Parser dirs)

Description

@vstinner
vstinner
opened on Aug 29, 2018
BPO 34544
Nosy @vstinner
PRs
  • bpo-34544: _Py_CoerceLegacyLocale() restores LC_CTYPE on fail #9044
  • bpo-34544: pymain_read_conf() don't change LC_ALL #9045
  • [3.7] bpo-34544: _Py_CoerceLegacyLocale() restores LC_CTYPE on fail (GH-9044) #9046
    		•

    Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
closed_at = <Date 2018-09-03.20:17:51.296>
created_at = <Date 2018-08-29.23:37:46.027>
labels = ['interpreter-core', '3.8']
title = 'FreeBSD: Fatal Python error: get_locale_encoding: failed to get the locale encoding: nl_langinfo(CODESET) failed'
updated_at = <Date 2018-09-03.20:17:51.294>
user = 'https://github.com/vstinner'

    bugs.python.org fields:

    activity = <Date 2018-09-03.20:17:51.294>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2018-09-03.20:17:51.296>
closer = 'vstinner'
components = ['Interpreter Core']
creation = <Date 2018-08-29.23:37:46.027>
creator = 'vstinner'
dependencies = []
files = []
hgrepos = []
issue_num = 34544
keywords = ['patch']
message_count = 8.0
messages = ['324361', '324378', '324512', '324516', '324522', '324527', '324533', '324534']
nosy_count = 1.0
nosy_names = ['vstinner']
pr_nums = ['9044', '9045', '9046']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue34544'
versions = ['Python 3.8']

    Activity

    1. vstinner commented on Aug 29, 2018

      @vstinner
      vstinner
      on Aug 29, 2018
      MemberAuthor

      It seems like my recent work on Python initialization broke Python on FreeBSD. Many test_c_locale_coerce tests now fail with:

      "Fatal Python error: get_locale_encoding: failed to get the locale encoding: nl_langinfo(CODESET) failed"

      Example of failed buildbot build:

      https://buildbot.python.org/all/#/builders/87/builds/1340

      It seems like this buildbot started to fail at this build:

      https://buildbot.python.org/all/#/builders/87/builds/1332

      This build has been triggered by this change:

      commit 177d921
      Author: Victor Stinner <vstinner@redhat.com>
      Date: Wed Aug 29 11:25:15 2018 +0200

      bpo-34485, Windows: LC_CTYPE set to user preference (GH-8988)

On Windows, the LC_CTYPE is now set to the user preferred locale at
startup: _Py_SetLocaleFromEnv(LC_CTYPE) is now called during the
Python initialization. Previously, the LC_CTYPE locale was "C" at
startup, but changed when calling setlocale(LC_CTYPE, "") or
setlocale(LC_ALL, "").

pymain_read_conf() now also calls _Py_SetLocaleFromEnv(LC_CTYPE) to
behave as _Py_InitializeCore(). Moreover, it doesn't save/restore the
LC_ALL anymore.

On Windows, standard streams like sys.stdout now always use
surrogateescape error handler by default (ignore the locale).

      test_c_locale_coerce tests invalid locales like LANG="invalid.ascii". It seems like Python supported such configuration before my changes.

      My recent work:

    2. vstinner
      added
      3.8 (EOL)end of life
      interpreter-core(Objects, Python, Grammar, and Parser dirs)
      on Aug 29, 2018

    3. vstinner commented on Aug 30, 2018

      @vstinner
      vstinner
      on Aug 30, 2018
      MemberAuthor

      I cannot reproduce the issue on my FreeBSD 11.1 VM. I cannot reproduce the issue on Koobs's "CURRENT-amd64%" buildbot neither :-(

      Example:

      CURRENT-amd64% env -i LC_ALL=invalid LC_CTYPE=invalid LANG=invalid PYTHONUTF8=0 PYTHONCOERCECLOCALE=0 ./python -X utf8=0 -c pass

      (no error)

    4. vstinner commented on Sep 3, 2018

      @vstinner
      vstinner
      on Sep 3, 2018
      MemberAuthor

      New changeset f01b2a1 by Victor Stinner in branch 'master':
      bpo-34544: Fix setlocale() in pymain_read_conf() (GH-9041)
      f01b2a1

    5. vstinner commented on Sep 3, 2018

      @vstinner
      vstinner
      on Sep 3, 2018
      MemberAuthor

      My fix didn't work :-(

      https://buildbot.python.org/all/#/builders/87/builds/1355

      ...
      Fatal Python error: get_locale_encoding: failed to get the locale encoding: nl_langinfo(CODESET) failed
      ...

    6. vstinner commented on Sep 3, 2018

      @vstinner
      vstinner
      on Sep 3, 2018
      MemberAuthor

      New changeset 8ea0911 by Victor Stinner in branch 'master':
      _Py_CoerceLegacyLocale() restores LC_CTYPE on fail (GH-9044)
      8ea0911

    7. vstinner commented on Sep 3, 2018

      @vstinner
      vstinner
      on Sep 3, 2018
      MemberAuthor

      New changeset 73b00be by Victor Stinner in branch 'master':
      bpo-34544: pymain_read_conf() don't change LC_ALL (GH-9045)
      73b00be

    8. vstinner commented on Sep 3, 2018

      @vstinner
      vstinner
      on Sep 3, 2018
      MemberAuthor

      New changeset 84b0129 by Victor Stinner in branch '3.7':
      _Py_CoerceLegacyLocale() restores LC_CTYPE on fail (GH-9044) (GH-9046)
      84b0129

    9. vstinner commented on Sep 3, 2018

      @vstinner
      vstinner
      on Sep 3, 2018
      MemberAuthor

      test_c_locale_coerce pass again on AMD64 FreeBSD 10.x Shared 3.x, I close the issue.

    10. vstinner
      closed this as completedon Sep 3, 2018
    11. ezio-melotti
      transferred this issue fromon Apr 10, 2022
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

    Metadata

    Metadata

    Assignees

    No one assigned

      Labels

      3.8 (EOL)end of lifeinterpreter-core(Objects, Python, Grammar, and Parser dirs)

      Projects

      No projects

        Milestone

        No milestone

        Relationships

        None yet

        Development

        No branches or pull requests

        Issue actions