Skip to content

integrate with dask #530

Open
Open
integrate with dask#530
Labels
difficulty: highenhancementpriority: lowsize: big
Milestone
nice_to_have

Description

@gdementen
gdementen
opened on Nov 22, 2017

To be able to parallelize/distribute workload and work on arrays larger than memory.

Dask custom collections protocol could help:
http://dask.pydata.org/en/latest/custom-collections.html#custom-collections

Activity

  1. gdementen
    added
    enhancement
    difficulty: high
    on Nov 22, 2017
  2. alixdamman
    added this to the nice_to_have milestone on Mar 7, 2018
  3. alixdamman
    added
    priority: low
    on Mar 7, 2018

  4. gdementen commented on May 3, 2018

    @gdementen
    gdementen
    on May 3, 2018
    ContributorAuthor

    Vaex is also a possibility to do (possibly the same thing). https://vaex.io/

  5. gdementen
    removed this from the milestone on Aug 1, 2019
  6. gdementen
    added
    size: big
    on Aug 1, 2019
  7. alixdamman
    added this to the nice_to_have milestone on Oct 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    difficulty: highenhancementpriority: lowsize: big

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions