You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Provide a way to check for *real* typing.Union instances #73448
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee=Noneclosed_at=<Date2019-05-30.23:47:25.261>created_at=<Date2017-01-13.15:45:47.284>labels= ['3.8', 'type-feature', 'library']
title='Provide a way to check for *real* typing.Union instances'updated_at=<Date2019-05-30.23:47:25.256>user='https://github.com/flying-sheep'
typing.Union prevents the use of isinstance and issubclass via a hook.
This is presumably to prevent errors that would arise if someone tried to do issubclass(A, Union[A, B]) or isinstance(A(), Union[A, B]), because Union isn’t specified in the PEP to allow a check like this, and doesn’t implement it. (Instead it throws said error)
However, as far as I can see there is no blessed way to check if an object was returned by Union.__getitem__(). A simple way that works is:
In principle, such a function could be added if it is not called isinstance. For example, we could add a helper is_union(tp) (or maybe also is_generic(tp) etc). Such function(s) will be simple one-liners wrapping private API in a right way (e.g. using _gorg instead of origin where needed etc).
Hm, maybe isinstance(t, Union) should actually be allowed? (Though isinstance(x, Union[int, str]) should not be!) After all we can write isinstance(t, Callable) as well, even though isinstance(x, Callable[[int], int]) is disallowed.
This will be a bit unusual since isinstance is typically called for instances (i.e. not types) as in isinstance(func, Callable). But on the other hand this is probably what one would expect when one sees isinstance(tp, Union). Thus I am fine with doing it this way.
If there are no objections/other ideas, then I will make a PR upstream in next few days.
Hm, let me back-pedal a bit. The situation with Callable is murky, as e.g. isinstance(typing.Tuple[int, int], typing.Callable) returns True.
Maybe we need to take a step back and look at the needs for code that wants to implement runtime type checking more in general? ISTM we have ways to access the parameters of a parameterized type (typically t.__parameters__) but we don't have a reasonable way yet to determine what kind of thing t is.
Maybe we need to take a step back and look at the needs for code that wants to implement runtime type checking more in general?
I would say that the most convenient way for me would be a set of "inspect-style" simple helpers like is_union, is_generic, get_parameters (similar to inspect.ismethod, inspect.getargspec etc).
ISTM we have ways to access the parameters of a parameterized type (typically t.__parameters__) but we don't have a reasonable way yet to determine what kind of thing t is.
There is one way that I see right now: using _gorg. For example, _gorg(Tuple[int, str]) is Tuple, _gorg(Callable[..., str]) is Callable, etc. This will also work for Union if we relax the assert that requires type to be instance of GenericMeta (now there is a common internal API used by almost everything in typing).
Maybe we need to take a step back and look at the needs for code that
wants to implement runtime type checking more in general?
I would say that the most convenient way for me would be a set of
"inspect-style" simple helpers like is_union, is_generic, get_parameters (similar to inspect.ismethod, inspect.getargspec etc).
ISTM we have ways to access the parameters of a parameterized type
(typically t.parameters) but we don't have a reasonable way yet to
determine what kind of thing t is.
There is one way that I see right now: using _gorg. For example, _gorg(Tuple[int, str]) is Tuple, _gorg(Callable[..., str]) is Callable, etc. This will also work for Union if we relax the assert
that requires type to be instance of GenericMeta (now there is a common
internal API used by almost everything in typing).
Maybe a proposal should be discussed as an addendum to PEP-484? Or would
Mark Shannon reject that?
On one hand, I would like to involve a wider audience to this discussion. On the other hand, an addition to the PEP could slow things down. Maybe a discussion on python-dev followed by implementation plus extensive docs would work?
Posting to python-dev would probably cause more friction than a PR for the
PEPs repo. But maybe the best way to do this is to use a third party module
with a proposed API? E.g. typing_inspect. We could then iterate quickly on
the design and implementation there, and we could commit to keeping it in
sync with changes to typing.py, so flying sheep's package could depend on
it.
I have a similar idea. We already have mypy_extensions for runtime counterparts of experimental features. However, the runtime inspections are not related to mypy, so that I am not sure. I am just a bit worried there will be to many things to keep in mind/in sync. What do you think?
By the way maybe later we could add typing.inspect similar to typing.re and typing.io?
I think it should be separate from mypy_extensions, since it's not even
related to mypy.
Regarding typing.re and typing.io, typing.inspect would be a typed version
of the inspect module, so that's not quite the same. (Though I consider
typing.re/io mistakes now -- people seem to mostly ignore it and use the
toplevel names.)
How then it should be done logistically? Should I just make a separate repo on GitHub for this? Or will it be inside typing (like mypy_extesions is inside mypy) but published on PyPI separately?
OK, I will make a PR to typing adding a folder (as it is done for mypy_extensions) with a basic set of runtime type inspection functions.
flying-sheep commented on Jan 16, 2017
flying-sheepmannequin
MannequinAuthor
More actions
Cool! This set of basic initial check will consist of all the is_* functions that were mentioned right?
FWIW I also think that this is the way to go, as it’s not obvious if the semantics should be “conforms to this type annotation” or “is a type annotation of that kind” or other variants.
In case this isn’t already too much future think: What should be the way forward from there? E.g. when working with Union[A, B], you will probably want to get “(A, B)”.
So will that mean more introspection functions (like union_types(Union[str,int]),
or public APIs for typings (e.g. a_union.__iter__() or a_union.types)?
New changeset 4c23aff by Ivan Levkivskyi in branch 'master': bpo-29262: Add get_origin() and get_args() introspection helpers to typing (GH-13685) 4c23aff
Activity
flying-sheep commentedon Jan 13, 2017
typing.Union prevents the use of
isinstanceandissubclassvia a hook.This is presumably to prevent errors that would arise if someone tried to do issubclass(A, Union[A, B]) or isinstance(A(), Union[A, B]), because Union isn’t specified in the PEP to allow a check like this, and doesn’t implement it. (Instead it throws said error)
However, as far as I can see there is no blessed way to check if an object was returned by Union.__getitem__(). A simple way that works is:
but _Union is a private class, and an implementation detail.
is there a blessed way to do this? If not, one should be added.
evanunderscore commentedon Jan 14, 2017
I'm also interested in this. I've been using 'thing.__origin__ is typing.Union', but this doesn't work in some of the older versions of typing.
ilevkivskyi commentedon Jan 15, 2017
In principle, such a function could be added if it is not called
isinstance. For example, we could add a helperis_union(tp)(or maybe alsois_generic(tp)etc). Such function(s) will be simple one-liners wrapping private API in a right way (e.g. using _gorg instead of origin where needed etc).Guido, what do you think?
gvanrossum commentedon Jan 15, 2017
Hm, maybe isinstance(t, Union) should actually be allowed? (Though isinstance(x, Union[int, str]) should not be!) After all we can write isinstance(t, Callable) as well, even though isinstance(x, Callable[[int], int]) is disallowed.
ilevkivskyi commentedon Jan 15, 2017
This will be a bit unusual since
isinstanceis typically called for instances (i.e. not types) as inisinstance(func, Callable). But on the other hand this is probably what one would expect when one seesisinstance(tp, Union). Thus I am fine with doing it this way.If there are no objections/other ideas, then I will make a PR upstream in next few days.
gvanrossum commentedon Jan 15, 2017
Hm, let me back-pedal a bit. The situation with Callable is murky, as e.g. isinstance(typing.Tuple[int, int], typing.Callable) returns True.
Maybe we need to take a step back and look at the needs for code that wants to implement runtime type checking more in general? ISTM we have ways to access the parameters of a parameterized type (typically t.__parameters__) but we don't have a reasonable way yet to determine what kind of thing t is.
ilevkivskyi commentedon Jan 15, 2017
I would say that the most convenient way for me would be a set of "inspect-style" simple helpers like
is_union,is_generic,get_parameters(similar to inspect.ismethod, inspect.getargspec etc).There is one way that I see right now: using _gorg. For example,
_gorg(Tuple[int, str]) is Tuple,_gorg(Callable[..., str]) is Callable, etc. This will also work forUnionif we relax the assert that requires type to be instance of GenericMeta (now there is a common internal API used by almost everything in typing).gvanrossum commentedon Jan 15, 2017
Maybe a proposal should be discussed as an addendum to PEP-484? Or would
Mark Shannon reject that?
On Sun, Jan 15, 2017 at 2:48 PM, Ivan Levkivskyi <report@bugs.python.org>
wrote:
ilevkivskyi commentedon Jan 15, 2017
On one hand, I would like to involve a wider audience to this discussion. On the other hand, an addition to the PEP could slow things down. Maybe a discussion on python-dev followed by implementation plus extensive docs would work?
gvanrossum commentedon Jan 15, 2017
Posting to python-dev would probably cause more friction than a PR for the
PEPs repo. But maybe the best way to do this is to use a third party module
with a proposed API? E.g. typing_inspect. We could then iterate quickly on
the design and implementation there, and we could commit to keeping it in
sync with changes to typing.py, so flying sheep's package could depend on
it.
ilevkivskyi commentedon Jan 15, 2017
I have a similar idea. We already have mypy_extensions for runtime counterparts of experimental features. However, the runtime inspections are not related to mypy, so that I am not sure. I am just a bit worried there will be to many things to keep in mind/in sync. What do you think?
By the way maybe later we could add
typing.inspectsimilar totyping.reandtyping.io?gvanrossum commentedon Jan 15, 2017
I think it should be separate from mypy_extensions, since it's not even
related to mypy.
Regarding typing.re and typing.io, typing.inspect would be a typed version
of the inspect module, so that's not quite the same. (Though I consider
typing.re/io mistakes now -- people seem to mostly ignore it and use the
toplevel names.)
ilevkivskyi commentedon Jan 15, 2017
OK, I agree.
How then it should be done logistically? Should I just make a separate repo on GitHub for this? Or will it be inside typing (like mypy_extesions is inside mypy) but published on PyPI separately?
gvanrossum commentedon Jan 15, 2017
Up to you, but the latter might make it clearer that the two are to be kept
in sync.
ilevkivskyi commentedon Jan 15, 2017
OK, I will make a PR to typing adding a folder (as it is done for mypy_extensions) with a basic set of runtime type inspection functions.
flying-sheep commentedon Jan 16, 2017
Cool! This set of basic initial check will consist of all the is_* functions that were mentioned right?
FWIW I also think that this is the way to go, as it’s not obvious if the semantics should be “conforms to this type annotation” or “is a type annotation of that kind” or other variants.
In case this isn’t already too much future think: What should be the way forward from there? E.g. when working with Union[A, B], you will probably want to get “(A, B)”.
So will that mean more introspection functions (like union_types(Union[str,int]),
or public APIs for typings (e.g. a_union.__iter__() or a_union.types)?
ilevkivskyi commentedon Jan 28, 2017
Cross-posting the link to upstream work on this: python/typing#377
ilevkivskyi commentedon May 9, 2017
The discussed functionality is published as a separate package:
https://pypi.python.org/pypi/typing-inspect
https://github.com/ilevkivskyi/typing_inspect
After the API is settled, some introspection functions may be added directly to typing.
ilevkivskyi commentedon May 30, 2019
New changeset 4c23aff by Ivan Levkivskyi in branch 'master':
bpo-29262: Add get_origin() and get_args() introspection helpers to typing (GH-13685)
4c23aff