All pull requests

Pull requests

• [SPARK-60546][SQL] Reject subtraction of nanosecond-precision timestamps

  #59785·stevomitric opened Oct 25, 2026Contributor·

  ·

• [SPARK-60544][SQL] Run the dynamic partition checks before saveAsTable overwrite drops the existing Hive table

  #59784·dongjoon-hyun opened Oct 25, 2026Member·

  ·
  2

• [SPARK-60545][SQL] Raise a clear error for TIMESTAMP_NTZ columns in Hive serde tables

  #59783·dongjoon-hyun opened Oct 25, 2026Member·

  ·

• [SPARK-60543][SQL] Support nanosecond-precision timestamps in date_add/date_sub

  #59782·stevomitric opened Oct 25, 2026Contributor·

  ·

• [SPARK-60542][SQL] Support nanosecond-precision timestamps in percentile, median, percentile_cont and percentile_disc

  #59781·stevomitric opened Oct 25, 2026Contributor·

  ·

• [SPARK-60540][SQL] Floor Arrow nanosecond timestamps to the column precision on read

  #59780·stevomitric opened Oct 25, 2026Contributor·

  ·

• [SPARK-58201][SQL] Optimize sliding window MIN/MAX aggregate function…

  #59779·pavan51 opened Oct 25, 2026Contributor·

  ·

• [SPARK-60241][PYTHON][CONNECT] Fall back from Arrow Python UDFs when server packages are unavailable

  #59778·lisancao opened Oct 25, 2026·

  ·

• [SPARK-60533][SS] Enable spark.sql.streaming.checkpoint.renamedFileCheck.enabled by default

  #59777·pratham76 opened Oct 25, 2026Contributor·

  ·

• [SPARK-60532][PYTHON] Chain UDF functions in EvalTypeHandler and enforce single-UDF handlers in the base

  #59776·Yicong-Huang opened Oct 25, 2026Contributor·

  ·

• [SPARK-60530][PYTHON] Drop redundant run-level fail_on_stopiteration in ArrowElementwiseUDFHandler

  #59775·Yicong-Huang opened Oct 24, 2026Contributor·

  ·

• [SPARK-60529][PYTHON] Wrap pandas scalar iterator UDFs in fail_on_stopiteration

  #59774·Yicong-Huang opened Oct 24, 2026Contributor·

  ·

• [SPARK-60538][PYTHON] Guard optional dependencies in Python tests

  #59773·zhangxinyao88 opened Oct 24, 2026Contributor·

  ·

• [SPARK-60537][PROTOBUF] Fix descriptor lookup in ProtobufSerdeSuite

  #59772·zhangxinyao88 opened Oct 24, 2026Contributor·

  ·

• [SPARK-60528][SQL] Fix ExpressionEncoder assertion failure on nested empty structs

  #59771·dongjoon-hyun opened Oct 24, 2026Member·

  ·

• [MINOR][SQL] Use QueryCompilationErrors.nullArgumentError for null messageName in to_protobuf/from_protobuf

  #59767·Sid4030 opened Oct 24, 2026·

  ·

• [SPARK-60527][SQL] Do not overwrite existing partitions in ALTER TABLE ADD IF NOT EXISTS PARTITION when updating stats

  #59765·sambhav37 opened Oct 24, 2026Contributor·

  ·
  1

• [SPARK-58511][SQL][FOLLOWUP] Require more compaction to keep adaptive partial aggregation when it would spill

  #59764·cloud-fan opened Oct 24, 2026Contributor·

  ·
  26

• [SPARK-60487][SQL] Return zero for pushed counts over empty file scans

  #59763·xgbtxy opened Oct 24, 2026·

  ·
  2

• [WIP] Dedup within watermark incremental cleanup

  #59762·jerrypeng opened Oct 23, 2026Contributor·

  ·

• [SPARK-60525][SQL] Wrap RelationChanges directly in NamedStreamingRelation for streaming CHANGES queries

  #59761·AnishMahto opened Oct 23, 2026Contributor·

  ·
  1

• [SPARK-60522][SQL] Fix storage-partitioned join failures when Spark cannot evaluate a partition transform

  #59760·metanil opened Oct 23, 2026·

  ·
  7

• [SPARK-55888][K8S] Parallel pod creation for Kubernetes executor allocation

  #59756·TongWei1105 opened Oct 23, 2026Contributor·

  ·
  1

• [SPARK-60517][SQL] Fix mixed timestamp ordering in SQL ASOF joins

  #59753·vranes opened Oct 23, 2026Contributor·

  ·
  2

• [SPARK-60507][SQL] Reuse schema resolution connection to read JDBC database metadata

  #59748·craiuconstantintiberiu opened Oct 23, 2026Contributor·

  ·
  2