Search

Pull requests

• feat: support scalar Variant extraction for foldable paths

  area:expressionsenhancement
  #6595·peterxcli opened Oct 4, 2026Member·

  ·
  10

• feat: add native Variant null and validity predicates

  area:expressionsarea:joinsarea:scanenhancement
  #6594·peterxcli opened Oct 4, 2026Member·

  ·
  1

• feat: support native Variant columnar-to-row conversion

  area:ffienhancement
  #6589·peterxcli opened Oct 4, 2026Member·

  ·
  1

• feat: support whole-value Variant scan pushdown

  area:expressionsarea:scanenhancement
  #6443·peterxcli opened Sep 30, 2026Member·

  ·
  1

• fix: free and account for native shuffle spill metadata

  area:shufflebugrun-spark-4.1-tests
  #6440·peterxcli opened Sep 30, 2026Member·

  ·
  1

  3

• fix: preserve Spark errors for Parquet timestamp overflow

  area:joinsarea:scanbug
  #5891·peterxcli opened Sep 13, 2026Member·

  ·
  1

  15

• feat: add native Iceberg CDC and micro-batch execution

  area:Icebergarea:scanenhancement
  #5888·peterxcli opened Sep 12, 2026Member·

  ·
  1

• perf: add opt-in delta encoding for cached longs

  enhancementperformance
  #5869·peterxcli opened Sep 11, 2026Member·

  ·

• fix: enforce null-key rejection and mapKeyDedupPolicy in native map construction

  area:expressionsarea:Icebergarea:shufflearea:writerbug
  #5854·peterxcli opened Sep 10, 2026Member·

  ·
  2

  22

• perf: nested struct statistics pruning

  #5772·peterxcli opened Sep 8, 2026Member·

  ·

• perf: optimize JVM columnar-to-row conversion

  area:ffienhancementperformance
  #5496·peterxcli opened Aug 27, 2026Member·

  ·

  · 1.2.0
  1

  4

• feat: full native make_interval with 2.6x faster than spark and 1.1x faster than codegen dispatch

  area:expressionsarea:udfenhancementperformancetemporal expressions
  #5292·peterxcli opened Aug 7, 2026Member·

  ·
  2

  13

• test: enable SPARK-57298 collect_set tests

  area:aggregationarea:expressionsarea:Icebergarea:scanenhancementrun-spark-4.2-testsspark 4.2test
  #5228·peterxcli opened Aug 3, 2026Member·

  ·
  1

  4

• refactor: use arrow make_comparator for nested structural equality in arrays_overlap and array_position [2/2]

  area:expressionsarray expressionsenhancement
  #5194·peterxcli opened Aug 1, 2026Member·

  ·
  1

  10

• feat: support ANSI interval types in native Parquet scans

  area:expressionsarea:scanenhancement
  #5161·peterxcli opened Jul 31, 2026Member·

  ·
  1

  12

• feat: native Arrow UDF path to grouped-aggregate, window, and applyInArrow Python operators

  area:udfenhancement
  #5157·peterxcli opened Jul 31, 2026Member·

  ·
  1

• fix: fall back for Parquet datetime rebasing

  area:scanarea:writerbugcorrectness
  #5048·peterxcli opened Jul 27, 2026Member·

  ·
  1

  6

• feat: add native Parquet datetime rebasing

  area:scanenhancement
  #5047·peterxcli opened Jul 27, 2026Member·

  ·
  1

• feat: account JVM UDF Arrow allocations in Spark task memory

  area:expressionsarea:memoryarea:udfenhancement
  #5027·peterxcli opened Jul 24, 2026Member·

  ·
  1

  29

• fix: honor Spark’s commit protocol in Spark 3.x native writes

  area:scanarea:writerenhancementrun-all-spark-profiles
  #4746·peterxcli opened Jun 28, 2026Member·

  ·

  · 1.2.0
  13