Implement lazy Session objects #727

Activity

1. alixdamman

   added

   enhancement

   question

   on Nov 28, 2018
2. alixdamman

   added this to the 0.30 milestone on Nov 28, 2018
3. alixdamman

   assigned

   gdementen

   and

   alixdamman

   on Nov 28, 2018
4. gdementen commented on Nov 28, 2018

   

   gdementen

   on Nov 28, 2018

   Contributor

   More actions

   I have some working proof-of-concept code for lazy Session objects in my experiments folder. It assumes you declare your sessions and arrays like this:

   class Demo(StaticSession):
       hh = ArrayDef()
       pop = ArrayDef("a=a0..a3")

   instead of creating arrays filled with zeros. This also gets you completion for session arrays. Arrays are then loaded when first used. FWIW, in the example above "hh" is lazy but can have any shape/axes while "pop" is checked that it contains an a axis with those labels. I don't remember how much work is still needed for this to be actually usable, but I think it was significant. Anyway, I think 0.30 is way too early for that feature (at least if I have to do it).

   I think we could also support some form of LazyArray outside of a session but that probably needs even more work (if at all possible) and I am unsure it is worth it. I would have to think about that. It's hard to say before hand.
5. alixdamman

   changed the title [-]Implement lazy LArray objects[/-] [+]Implement lazy Session objects[/+] on Nov 28, 2018
6. alixdamman commented on Nov 28, 2018

   

   alixdamman

   on Nov 28, 2018

   CollaboratorAuthor

   More actions

   I don't think having LazyArray outside of a session is needed. IMO, implementing StaticSession would be enough. Users should NOT declare variables as global.

   I wonder if after implementing StaticSession we should not make global_arrays and arrays private functions and use them internally only when calling view() or edit() without argument?
7. alixdamman

   modified the milestones: 0.30, 0.31 on Nov 28, 2018
8. alixdamman

   added

   difficulty: high

   and removed

   question

   on Nov 28, 2018
9. gdementen commented on Nov 28, 2018

   

   gdementen

   on Nov 28, 2018

   Contributor

   More actions

   I wonder if after implementing StaticSession we should not make global_arrays and arrays private functions and use them internally only when calling view() or edit() without argument?

   I don't think so. There are cases where global_arrays()/arrays() will still be more practical than creating a Session explicitly. It's ugly but practical... Time will tell...
10. gdementen

    removed this from the 0.31 milestone on Aug 1, 2019
11. gdementen

    added

    size: big

    on Aug 1, 2019
12. 1 remaining item

    Load more
13. alixdamman

    removed their assignment

    on Oct 1, 2019
14. gdementen

    added

    priority: high

    on Oct 7, 2019
15. gdementen commented on Oct 7, 2019

    

    gdementen

    on Oct 7, 2019

    Contributor

    More actions

    I don't think I will have time to finish a clean version of this in time for the release.
16. gdementen

    removed this from the 0.32 milestone on Oct 7, 2019
17. alixdamman

    added this to the nice_to_have milestone on Oct 10, 2019
18. alixdamman

    modified the milestones: nice_to_have, 0.33 on Dec 19, 2019
19. gdementen

    modified the milestones: 0.33, 0.34 on Jul 29, 2021
20. gdementen

    modified the milestones: 0.34, 0.35 on Sep 13, 2022
21. gdementen

    modified the milestones: 0.35, 0.36 on Sep 11, 2023
22. gdementen

    modified the milestones: 0.36, 0.37 on Oct 6, 2025