Issues

• feat: add match_columns_by_header option for CSV

  auto detected api changecommoncoredatasourcedocumentationprotosqllogictest
  Unread
  apache/datafusion#27021·wyatt-herkamp opened Nov 2, 2026 · Updated Nov 3, 2026
  1

• feat: physical optimizer rules declare whether they run before or after enforcement

  api changeauto detected api changecoredocumentationffioptimizersqllogictest
  Unread
  apache/datafusion#26979·jayzhan211 opened Nov 1, 2026 · Updated Nov 1, 2026
  3

• feat: option to error instead of skipping files that don't match partition columns

  auto detected api changecatalogcommondocumentationsqllogictest
  Unread
  apache/datafusion#26943·xanderbailey opened Oct 30, 2026 · Updated Nov 2, 2026
  3

• Add SessionContext::read_columns and deprecate DataFrame::from_column…

  auto detected api changecoredocumentation
  Unread
  apache/datafusion#26934·cj-zhukov opened Oct 30, 2026 · Updated Oct 30, 2026
  1

• refactor(substrait): pass immutable scope context through consumers

  auto detected api changesubstrait
  Unread
  apache/datafusion#26890·alexanderbianchi opened Oct 29, 2026 · Updated Oct 29, 2026·Draft
  1

• feat: represent source-defined key groups separately from native hash

  auto detected api changedatasourcedocumentationffioptimizerphysical-exprphysical-plan
  Unread
  apache/datafusion#26875·wirybeaver opened Oct 29, 2026 · Updated Oct 29, 2026·Draft
  1

• feat: give logical plan columns an identity (ColumnId)

  auto detected api changecommoncorelogical-exproptimizerprotosqlsqllogictestsubstrait
  Unread
  apache/datafusion#26842·cetra3 opened Oct 28, 2026 · Updated Oct 28, 2026·Draft
  1

• proto: layered DataSource / FileSource / DataSink nodes (precursor to #26555, #26807)

  auto detected api changedatasourcedocumentationproto
  Unread
  apache/datafusion#26824·adriangb opened Oct 27, 2026 · Updated Oct 29, 2026
  5

• feat: add a physical analyzer phase that hands the optimizer a valid plan

  api changeauto detected api changecoredocumentationffioptimizerphysical-planprotosqllogictest
  Unread
  apache/datafusion#26757·jayzhan211 opened Oct 26, 2026 · Updated Nov 1, 2026
  24

• feat: allow downcasting ParquetFileReaderFactory

  auto detected api changedatasourcedocumentation
  Unread
  apache/datafusion#26635·morristai opened Oct 23, 2026 · Updated Oct 23, 2026
  1

• perf: Optimize repeated counting of set bits

  auto detected api changecommonfunctionsspark
  Unread
  apache/datafusion#26507·neilconway opened Oct 19, 2026 · Updated Oct 29, 2026
  16

• fix: preserve ExprFunctionExt options when chaining

  auto detected api changecoredocumentationfunctionslogical-exproptimizerprotosqlsubstrait
  Unread
  apache/datafusion#26486·goutamadwant opened Oct 18, 2026 · Updated Oct 25, 2026·Draft
  2

• perf: replace the routed hash join dynamic filter with one global filter (InList or bloom filter)

  auto detected api changecommoncoredocumentationphysical-plansqllogictest
  Unread
  apache/datafusion#26442·adriangb opened Oct 17, 2026 · Updated Nov 2, 2026·Draft
  61

• feat: report the ordering and partitioning of materialized CTE scans

  auto detected api changecorephysical-plansqllogictest
  Unread
  apache/datafusion#26428·adriangb opened Oct 16, 2026 · Updated Nov 2, 2026
  13

• WIP: Add parquet progressive_io option using ParquetPushDecoder::scan_plan (one-shot row group I/O with pushdown filters)

  auto detected api changecommoncoredatasourcedocumentationphysical-planprotosqllogictest
  Unread
  apache/datafusion#26387·alamb opened Oct 15, 2026 · Updated Oct 26, 2026·Draft
  18

• DRAFT: add a generic test suite for ExecutionPlans

  auto detected api changephysical-plan
  Unread
  apache/datafusion#26378·masonh22 opened Oct 15, 2026 · Updated Oct 15, 2026·Draft
  1

• feat: let SpillCompression::Zstd carry a compression level

  auto detected api changecommoncoredocumentationphysical-plansqllogictest
  Unread
  apache/datafusion#26365·KonaeAkira opened Oct 15, 2026 · Updated Oct 26, 2026
  2

• [WIP][Experimental] feat: add datafusion.execution.isolated_partitions for distributed-safe join selection

  auto detected api changecommoncoredocumentationoptimizerphysical-plansqllogictest
  Unread
  apache/datafusion#26330·andygrove opened Oct 14, 2026 · Updated Oct 14, 2026·Draft
  3

• feat: pick hash join mode at runtime from the build side (AQE without stages)

  auto detected api change
  Unread
  apache/datafusion#26328·andygrove opened Oct 14, 2026 · Updated Oct 31, 2026·Draft
  11

• feat(parquet): add NDV cap for dictionary reads

  auto detected api changecommondatasourcedocumentationprotosqllogictest
  Unread
  apache/datafusion#26315·Rich-T-kid opened Oct 14, 2026 · Updated Oct 26, 2026·Draft
  93

• fix: read Hive's null partition placeholder as NULL

  auto detected api changecatalogcommoncoredatasourcedocumentationsqllogictest
  Unread
  apache/datafusion#26310·xanderbailey opened Oct 14, 2026 · Updated Nov 2, 2026
  15

• feat: decide automatically when to materialize a CTE

  auto detected api changecommoncoredocumentationlogical-exproptimizersqlsqllogictest
  Unread
  apache/datafusion#26276·adriangb opened Oct 13, 2026 · Updated Oct 28, 2026
  2

• feat: push filters that all references share into the body of a materialized CTE

  auto detected api changecorelogical-exproptimizersqllogictest
  Unread
  apache/datafusion#26275·adriangb opened Oct 13, 2026 · Updated Oct 28, 2026
  2

• feat: prune unused columns from the body of a materialized CTE

  auto detected api changecoredocumentationlogical-exproptimizerphysical-plansqllogictest
  Unread
  apache/datafusion#26274·adriangb opened Oct 13, 2026 · Updated Oct 28, 2026
  2

• feat: protobuf serialization for the materialized CTE plan nodes

  auto detected api changelogical-exprphysical-planproto
  Unread
  apache/datafusion#26273·adriangb opened Oct 13, 2026 · Updated Oct 28, 2026
  2