feat: randomized contraction can be faster #887

Is your feature request related to a problem? Please describe.
.

Describe the solution you would like

• remove the CodegenFallback from UDF
• remove the distinct op
• remove the symmetrization and fuse it to representatives choosing

Component

• Scala Core Internal
• Scala API
• Spark Connect Plugin
• Infrastructure
• PySpark Classic
• PySpark Connect

Additional context

Are you planning on creating a PR?

• I'm willing to make a pull-request