All pull requests

Pull requests

• test: sweep Spark's -0.0 and NaN semantics across operators and float expressions

  enhancementtest
  #6521·andygrove opened Oct 1, 2026Member·

  ·

• fix: match Spark's float semantics in array_remove and sort_array

  area:expressionsbugrun-spark-4.1-tests
  #6518·andygrove opened Oct 1, 2026Member·

  ·

• docs: cut the release branch before fixing regressions, and add a diagram

  documentation
  #6517·andygrove opened Oct 1, 2026Member·

  ·

• docs: add release-behavior checks and the 1.1.0 audit's lessons to the review skills

  documentation
  #6516·andygrove opened Oct 1, 2026Member·

  ·

• fix: defer Parquet conversion errors until a row group is decoded, as Spark does

  area:scanbackport-1.1bugregressionrun-all-spark-profilesrun-spark-4.1-tests
  #6515·andygrove opened Oct 1, 2026Member·

  ·
  1

• fix: [branch-1.1] fall back to Spark for _metadata.file_block_start and file_block_length (#6510)

  area:scanbugregression
  #6511·andygrove opened Oct 1, 2026Member·

  ·

• fix: fall back to Spark for _metadata.file_block_start and file_block_length

  area:scanbackport-1.1bugregression
  #6510·andygrove opened Oct 1, 2026Member·

  ·
  1

• feat: reuse S3 credentials until shortly before their reported expiry

  area:Icebergarea:scanenhancement
  #6509·snmvaughan opened Oct 1, 2026Contributor·

  ·
  1

  11

• fix: build with Rust 1.99, which deprecates the legacy f64 constants and fetch_update

  area:expressionsarea:memorybug
  #6507·andygrove opened Oct 1, 2026Member·Queued
  1

• refactor: move the self-contained operators from core into a new operators crate

  area:expressionsarea:joinsenhancement
  #6503·andygrove opened Oct 1, 2026Member·

  ·

• fix: read the Iceberg write gate's storage scheme the same way the native factory does

  area:Icebergarea:scanarea:writerbug
  #6502·0lai0 opened Oct 1, 2026Contributor·

  ·
  1

  3

• fix: prefer Unsupported when combining nested cast support

  area:expressionsbug
  #6501·liupoyi-1031 opened Oct 1, 2026Contributor·

  ·
  1

  1

• feat: Experimental local execution mode that runs a whole query as one DataFusion graph

  enhancementrun-spark-4.1-tests
  #6500·viirya opened Oct 1, 2026Member·

  ·
  1

• fix: compact oversized nested list_extract buffers

  area:expressionsbug
  #6498·rich7420 opened Oct 1, 2026Contributor·

  ·
  1

• test: cover typed Dataset filters over sliced aggregate batches

  enhancementtest
  #6497·rich7420 opened Oct 1, 2026Contributor·

  ·

• perf: reduce Parquet runtime filter schema guard overhead

  area:joinsarea:scanenhancementperformance
  #6496·pingzh opened Oct 1, 2026Contributor·

  ·
  1

• test: share collation coverage across Spark 4.x

  enhancementrun-all-spark-profilestest
  #6495·sunchao opened Oct 1, 2026Member·

  ·
  1

• chore: move native write configs under spark.comet.write

  area:Icebergarea:writerenhancement
  #6494·zhangfengcdt opened Oct 1, 2026Member·

  ·
  1

  5

• fix: load the bundled native library only once per class loader

  bug
  #6493·zhangfengcdt opened Oct 1, 2026Member·

  ·
  1

  7

• test: [branch-1.1] cover sliced boolean arrays in explode (#6473)

  enhancementtest
  #6492·andygrove opened Oct 1, 2026Member·

  ·

• fix: [branch-1.1] coerce native IF branches to a common type (#6458)

  area:expressionsbug
  #6491·andygrove opened Oct 1, 2026Member·

  ·

• fix: [branch-1.1] rescale decimals in generated dispatchers (#6455)

  area:expressionsbug
  #6490·andygrove opened Oct 1, 2026Member·

  ·

• fix: [branch-1.1] fall back for incompatible regression aggregates (#6451)

  area:aggregationbug
  #6489·andygrove opened Oct 1, 2026Member·

  ·

• fix: [branch-1.1] make adaptive aggregation skipping opt-in (#6474)

  bug
  #6488·andygrove opened Oct 1, 2026Member·

  ·

• fix: [branch-1.1] fall back for rank limits over nested float keys (#6468)

  bug
  #6487·andygrove opened Oct 1, 2026Member·

  ·