Fix curses module compilation with ncurses6

@Yhg1s

BPO	25720
Nosy	@Yhg1s, @mdickinson, @serhiy-storchaka, @ma8ma, @yan12125
PRs	bpo-25720: curses: Fix check for whether WINDOW is a pad #1689 bpo-25720: Fix the method for checking pad state of curses WINDOW #4164 [3.6] bpo-25720: Fix the method for checking pad state of curses WINDOW (GH-4164) #4212 [2.7] bpo-25720: Fix the method for checking pad state of curses WINDOW (GH-4164) #4213
Dependencies	bpo-31891: Make curses compiling on NetBSD 7.1 and tests passing
Files	curses-ncurses6.patch curses-is_pad.patch join-test-issue28190-issue25720.patch: for testing

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2017-11-01.12:38:50.867>
created_at = <Date 2015-11-24.11:39:07.962>
labels = ['extension-modules', 'build', '3.7']
title = 'Fix curses module compilation with ncurses6'
updated_at = <Date 2017-11-01.12:38:50.865>
user = 'https://bugs.python.org/donmez'

bugs.python.org fields:

activity = <Date 2017-11-01.12:38:50.865>
actor = 'serhiy.storchaka'
assignee = 'none'
closed = True
closed_date = <Date 2017-11-01.12:38:50.867>
closer = 'serhiy.storchaka'
components = ['Extension Modules']
creation = <Date 2015-11-24.11:39:07.962>
creator = 'donmez'
dependencies = ['31891']
files = ['41148', '45002', '45037']
hgrepos = []
issue_num = 25720
keywords = ['patch']
message_count = 27.0
messages = ['255261', '258136', '258137', '258142', '261920', '261923', '278050', '278054', '278128', '278140', '278241', '278242', '278245', '278248', '278303', '278353', '278360', '278363', '287757', '294071', '296750', '305178', '305181', '305370', '305372', '305373', '305374']
nosy_count = 6.0
nosy_names = ['twouters', 'mark.dickinson', 'donmez', 'serhiy.storchaka', 'masamoto', 'yan12125']
pr_nums = ['1689', '4164', '4212', '4213']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'compile error'
url = 'https://bugs.python.org/issue25720'
versions = ['Python 2.7', 'Python 3.6', 'Python 3.7']

ncurses6 turned on NCURSES_OPAQUE, so now you have to use some helper functions instead of accessing the structs directly. This _should_ be compatible with ncurses5 though I didn't test it.

Original patch is from openSUSE.

Any patch review/comment ?

configure.ac directly uses w->_flags in a check. It looks that this check always fails with ncurses6.

Thats not an issue for ncurses because Include/py_curses.h does:

  #ifdef HAVE_NCURSES_H
  /* configure was checking <curses.h>, but we will
     use <ncurses.h>, which has all these features. */
  #ifndef WINDOW_HAS_FLAGS
  #define WINDOW_HAS_FLAGS 1
  #endif
  #ifndef MVWDELCH_IS_EXPRESSION
  #define MVWDELCH_IS_EXPRESSION 1
  #endif
  #endif

So it overrides WINDOW_HAS_FLAGS for ncurses case.

ping?

I suspect that the patch can break build with non-ncurses implementations or with old ncurses (when is_pad() was added?). Needed more direct feature check.

is_pad is added in ncurses 5.7-20090906 [1]. At least Mac OS X still ships ancient ncurses 5.7-20081102 [2], so an check in configure.ac is necessary. I'm trying it out.

[1] http://invisible-island.net/ncurses/NEWS.html#t20090906
[2] http://opensource.apple.com//source/ncurses/ncurses-46/ncurses/NEWS

Mark, do you have relation to this?

I tried to build curses module on Cygwin (Vista x86) using bpo-25720 patch. And it has been succeeded.
When test_curses ran without skip condition, it was same result as msg278060 (bpo-28190).

I found out build success reasons for cases of applying patch:
bpo-25720 -- implementation of WINDOW is opaque (but WINDOW_HAS_FLAGS is defined at Include/py_curses.h:61 ). However, curses module build went well to cover the _flags field from source code by is_pad.
bpo-14598 -- implementation of WINDOW is not opaque (WINDOWS_HAS_FLAGS is defined at configure script). Therefore, curses module build went well because WINDOW has the _flags field.
bpo-28190 -- implementation of WINDOW is opaque (WINDOW_HAS_FLAGS isn't defined: py_curses.h has been cleaned by patch). Hence, curses module build went well to remove the _flags field from source code at preprocessing.

All case tests on Cygwin have failed at unget_wch.

Mark, do you have relation to this?

Sorry, no. Whatever ncurses knowledge I may once have had has long since vanished.

I updated the patch that add configuration check for is_pad. the is_pad is wrapped into py_is_pad at Modules/_cursesmodule.c:932 by either of three ways.

Case one -- is_pad is found: Define the macro that is simple wrapping.
Case two -- is_pad is not found, however WINDOW has _flags field: Define the macro using _flags field.
Case three -- is_pad is not found, and WINDOW doesn't have _flags field: Define the macro that is always preprocessed to FALSE.

I succeeded to build curses module on Cygwin (Vista x86) using this patch.
This patch doesn't include that undo fixes for specific platforms.

@masamoto

@masamoto thank you!

What's the status on this? Can you please create a pull request on Github so we can continue there?

Hi, I finished various things and tackle the issue again, I opened PR 1689 at last.

Changes from previous patch:

If ncurses doesn't have both is_pad function and _flags field of WINDOW, NCURSES_OPAQUE is defined as zero to make WINDOW to non-opaque type before including ncurses.h.
The conditional compile on function definition are kept, it replaces WINDOW_HAS_FLAGS with py_is_pad macro itself.
Unindent the blocks that places after section of the conditional compile on function definition.

Ping. I updated PR a bit: macOS is joined to new compile condition and remove platform-specific condition.

I opened PR 4164 to improve the is_pad configure check and previous PR was closed.

I'll try to test this on NetBSD after fixing curses on NetBSD. It uses a different implementation of curses which don't support is_pad.

New changeset 8bc7d63 by Serhiy Storchaka (Masayuki Yamamoto) in branch 'master':
bpo-25720: Fix the method for checking pad state of curses WINDOW (bpo-4164)
8bc7d63

New changeset ff6ae4d by Serhiy Storchaka (Miss Islington (bot)) in branch '3.6':
bpo-25720: Fix the method for checking pad state of curses WINDOW (GH-4164) (bpo-4212)
ff6ae4d

New changeset 6ba0b58 by Serhiy Storchaka (Miss Islington (bot)) in branch '2.7':
bpo-25720: Fix the method for checking pad state of curses WINDOW (GH-4164) (bpo-4213)
6ba0b58

Thank you for your contribution Masayuki!

Install ncurses from Homebrew, if available

Install ncurses from Homebrew, if available (#2813)

Squashed commit of the following:

Navigation Menu

Repository navigation

Fix curses module compilation with ncurses6 #69906

6 remaining items

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Fix curses module compilation with ncurses6 #69906

Description

Activity

donmez commented on Nov 24, 2015

donmez commented on Jan 13, 2016

serhiy-storchaka commented on Jan 13, 2016

donmez commented on Jan 13, 2016

donmez commented on Mar 17, 2016

serhiy-storchaka commented on Mar 17, 2016

yan12125 commented on Oct 4, 2016

serhiy-storchaka commented on Oct 4, 2016

ma8ma commented on Oct 5, 2016

mdickinson commented on Oct 5, 2016

ma8ma commented on Oct 7, 2016

donmez commented on Oct 7, 2016

6 remaining items

donmez commented on Feb 14, 2017

ma8ma commented on May 21, 2017

ma8ma commented on Jun 24, 2017

ma8ma commented on Oct 29, 2017

serhiy-storchaka commented on Oct 29, 2017

serhiy-storchaka commented on Nov 1, 2017

serhiy-storchaka commented on Nov 1, 2017

serhiy-storchaka commented on Nov 1, 2017

serhiy-storchaka commented on Nov 1, 2017

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions