All pull requests

Pull requests

• [SPARK-59628][SQL] Reject ASOF JOIN without MATCH_CONDITION instead of a silent plain join

  #59001·LukaZdravic opened Sep 23, 2026Contributor·

  ·
  5

• [SPARK-59748][CORE] Loser tree + small-k linear merge for UnsafeSorterSpillMerger

  #58998·david-mollitor-db opened Sep 23, 2026Contributor·

  ·
  2

• [SPARK-59627][SQL] Report INCOMPATIBLE_JOIN_TYPES for unsupported join types for ASOF JOIN

  #58997·LukaZdravic opened Sep 23, 2026Contributor·

  ·
  1

• [SPARK-59747][CORE] Don't retry compaction of rolled event log files with malformed input

  #58996·DengYiping opened Sep 23, 2026·

  ·
  3

• [SPARK-59741][SQL] Run CALL at execution time

  #58994·matvei-zamiatin-db opened Sep 23, 2026Contributor·

  ·
  1

• [SPARK-59813][YARN] Dump thread stacks when SparkContext initialization times out in ApplicationMaster

  #58991·singer-bin opened Sep 23, 2026·

  ·
  3

• [SPARK-59146][SQL] Retain qualified access to source columns after pipe SET

  #58987·joelrobin18 opened Sep 23, 2026Contributor·

  ·

• [SPARK-59723][SQL] Skip preferred locations when ignoreDataLocality is enabled

  #58984·wangyum opened Sep 23, 2026Member·

  ·

• [SPARK-59725][K8S] Bind Volcano PodGroup with driver when podgroup creation

  #58982·ruanwenjun opened Sep 23, 2026Member·

  ·
  5

• [SPARK-59718][SQL] Add opt-in in-process Python UDF execution via Arrow C Data Interface

  #58978·viirya opened Sep 22, 2026Member·

  ·
  360

• [SPARK-59629][SQL] Resolve columnNameOfCorruptRecord with the case-sensitivity conf

  #58977·mrutunjay-kinagi opened Sep 22, 2026·

  ·

• [SPARK-59608][SQL] Keep the FILTER clause when OptimizeWindowFunctions rewrites first to nth_value

  #58976·mrutunjay-kinagi opened Sep 22, 2026·

  ·
  3

• [SPARK-59717][SQL] Fix MatchError when grouping by a UDT column backed by a primitive type

  #58975·jiwen624 opened Sep 22, 2026Contributor·

  ·
  3

• [WIP][K8S] Avoid scanning healthy executor pods in lifecycle processing

  #58974·ForVic opened Sep 22, 2026Contributor·

  ·

• [SPARK-59695][SDP] SCD1 Ignore-null support; Introduce version map in cdc_metadata

  #58973·AnishMahto opened Sep 22, 2026Contributor·

  ·

• [SPARK-59711][CORE] Stop LiveExecutorStageSummary from retaining a full v1.TaskMetrics tree

  #58968·wangyum opened Sep 22, 2026Member·

  ·
  24

• [SPARK-34122][SQL] Remove repeated deterministic CASE conditions

  #58967·xiaoh1024 opened Sep 22, 2026Contributor·

  ·

• [SPARK-59628][SQL] Report a missing MATCH_CONDITION in ASOF JOIN instead of parsing ASOF as an alias

  #58966·AMC-hawk opened Sep 22, 2026·

  ·

• [SPARK-59613] Fix intermittent 404s on SparkSQL ExecutionPage

  #58965·samra-h opened Sep 22, 2026·

  ·

• [SPARK-59697][CORE] Skip the redundant record comparator in the external-sort spill merge when the key prefix is a total order

  #58949·david-mollitor-db opened Sep 21, 2026Contributor·

  ·

• [SPARK-40608][SQL] Push necessary predicates from partially translatable V2 filters

  #58948·xiaoh1024 opened Sep 21, 2026Contributor·

  ·
  7

• [SPARK-59358][SDP] SCD2 Ignore-null support; Coalesce ignored-null values

  #58947·AnishMahto opened Sep 21, 2026Contributor·

  ·
  22

• [SPARK-57812][SQL] Support catalog column-statistics serialization for nanosecond-precision timestamps

  #58946·vrjdev opened Sep 21, 2026·

  ·
  5

• [SPARK-59609][SQL] Fix Parquet/ORC aggregate push-down reading statistics from the wrong column

  #58945·hemanthboyina opened Sep 21, 2026Contributor·

  ·
  2

• [SPARK-59671][SQL] Validate a co-partitioned pair by its children's pairing

  #58942·ulysses-you opened Sep 21, 2026Contributor·

  ·
  81