All pull requests

Pull requests

• [SPARK-59959][PYTHON] Migrate SQL_SCALAR_PANDAS_ITER_UDF and SQL_MAP_PANDAS_ITER_UDF to pandas eval type handlers

  #59211·Yicong-Huang opened Oct 2, 2026Contributor·

  ·
  5

• [WIP][CORE] Count objects behind fields that reflection can't read in SizeEstimator

  #59210·david-mollitor-db opened Oct 2, 2026Contributor·

  ·
  2

• [SPARK-59952][SQL] Avoid allocating lowercased copies in UTF8_LCASE contains for ASCII strings

  #59207·david-mollitor-db opened Oct 2, 2026Contributor·

  ·
  1

• [MINOR][PYTHON] Preserve decimal precision when decoding variants

  #59201·Arthur031221 opened Oct 2, 2026·

  ·
  1

• [SPARK-59948][SQL] Strip aliases from a DSv2 reported ordering on a nested field

  #59199·ykisana opened Oct 2, 2026·

  ·
  15

• [SPARK-59951][CORE] Avoid allocation and boxing in UTF8String ASCII case conversion

  #59198·david-mollitor-db opened Oct 2, 2026Contributor·

  ·
  2

• [SPARK-59950][CORE] Fix integer-division truncation in SizeEstimator's sampled-array extrapolation

  #59197·david-mollitor-db opened Oct 2, 2026Contributor·

  ·
  3

• [SPARK-59938][CONNECT] Improve cancellation for server-side Maven artifact resolution

  #59196·qianlan717 opened Oct 2, 2026Contributor·

  ·
  4

• [SPARK-57125][SQL] LimitPushDown should fold the merged limit so the plan stays plannable without ConstantFolding

  #59194·rdtr opened Oct 1, 2026·

  ·
  9

• [SPARK-59917][SQL] Do not rtrim CHAR arguments to from_json, from_csv, and from_xml

  #59188·srielau opened Oct 1, 2026Contributor·

  ·
  18

• [SPARK-50698][SQL] Refactor CreateUserDefinedFunctionCommand to extend from UnaryRunnableCommand

  #59184·zahed1994 opened Oct 1, 2026Contributor·

  ·
  5

• [SPARK-59921][SQL] Reuse MetricUtils constants in SQLMetrics instead of duplicating them

  #59183·vim89 opened Oct 1, 2026·

  ·
  6

• [WIP][SDP] Memoize flow reachability queries in the pipelines DataflowGraph

  #59179·david-mollitor-db opened Oct 1, 2026Contributor·

  ·

• [SPARK-59909][PYTHON] Fix PySpark errors raised with undefined error conditions or mismatched message parameters

  #59170·jubins opened Sep 30, 2026Contributor·1 task done·

  ·
  6

• [SPARK-59906][PYTHON][TESTS] Run relevant tests when JVM-launched Python worker scripts change under smart test selection

  #59169·gaogaotiantian opened Sep 30, 2026Contributor·

  ·
  2

• [SPARK-59722][SQL] Enforce CHAR/VARCHAR semantics for JSON map keys

  #59167·srielau opened Sep 30, 2026Contributor·

  ·
  30

• [WIP][CORE][SQL] Prototype compact UI storage and metric tracking

  #59164·gengliangwang opened Sep 30, 2026Member·

  ·

• [SPARK-59898][SQL] Compare BinaryType values by content in freqItems

  #59162·david-mollitor-db opened Sep 30, 2026Contributor·

  ·
  3

• [SPARK-59897][SQL] Support filters from both join children in PlanMerger

  #59161·hemanthboyina opened Sep 30, 2026Contributor·

  ·
  11

• [SPARK-59891][SQL] Classify only syntax error codes as syntax errors in Teradata dialect

  #59160·SEPURI-SAI-KRISHNA opened Sep 30, 2026Contributor·

  ·
  5

• [SPARK-59805][SQL] Avoid BigDecimal round trips for wide decimals that fit in a long in UnsafeRow

  #59159·dwsmith1983 opened Sep 30, 2026Contributor·

  ·
  3

• [SPARK-59886][UDF][TESTS][FOLLOWUP] Test scalar external UDFs end to end through a direct gRPC worker

  #59155·zozo123 opened Sep 30, 2026Contributor·

  ·
  3

• [SPARK-57468][SQL] Add SparkPlan.convention() API to support different columnar batch types

  #59154·zhztheplayer opened Sep 30, 2026Member·

  ·

• [SPARK-55569][SQL] Collapse non-matching pivot column values in fast-path firstAgg

  #59149·shrirangmhalgi opened Sep 30, 2026Contributor·

  ·
  8

• [SPARK-59369][SQL] Add integration testing for JDBC syntax error classification

  #59148·Admaing opened Sep 30, 2026·

  ·
  9