Skip to content

feat: explicitly select only required columns in all Pregel-based impls #696

Description

@SemyonSinchenko

Is your feature request related to a problem? Please describe.
After I added persist to the Pregel it give us a big performance boost. Unfortunately, there is a risk of slow down in case the input Graph contains too much attributes because we are not filtering them explicitly.

Describe the solution you would like
Explicitly select only required columns before persisting.

Component

  • Scala Core Internal
  • Scala API
  • Spark Connect Plugin
  • Infrastructure
  • PySpark Classic
  • PySpark Connect

Additional context

Are you planning on creating a PR?

  • I'm willing to make a pull-request

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions