All pull requests

Pull requests

• [SPARK-61268][K8S] Track Unschedulable executor pods as a distinct pod state and log the scheduler reason

  #60253·pushpavanthar opened Nov 9, 2026·

  ·

• [SPARK-61267][CORE][K8S] Apply ResourceProfile memory and cores confs in KubernetesExecutorBackend

  #60252·pushpavanthar opened Nov 9, 2026·

  ·

• [MINOR][BUILD] Ensure that dependencies are not mutated by toposort

  #60251·nchammas opened Nov 9, 2026Contributor·

  ·

• [SPARK-60649][PS] Keep the group name in GroupBy.apply and GroupBy.filter

  #60250·RonakkGovani opened Nov 9, 2026·

  ·

• [SPARK-60655][PS] Fix modulo with an infinite divisor in pandas API on Spark

  #60249·RonakkGovani opened Nov 9, 2026·

  ·

• [SPARK-61275][PYTHON] Fix wrong error type for out-of-range approxQuantile probabilities

  #60248·AlejandroMorgante opened Nov 9, 2026·

  ·
  4

• [SPARK-61257][SQL] Align the growing on-heap pages of hash join maps with heap regions

  #60247·dongjoon-hyun opened Nov 9, 2026Member·

  ·
  6

• [SPARK-61256][SQL] Fix wrong results by stale partitioning and ordering when a checkpointed Dataset is joined with its source

  #60246·dongjoon-hyun opened Nov 9, 2026Member·

  ·
  2

• [SPARK-61254][SQL] Fix wrong results by stale LogicalRDD constraints in checkpoints and recursive CTEs

  #60245·dongjoon-hyun opened Nov 9, 2026Member·

  ·
  3

• [SPARK-61253][PYTHON] Avoid parsing sys.version when detecting PyPy in cloudpickle

  #60244·LorenzoMartini opened Nov 9, 2026Contributor·

  ·
  5

• [SPARK-61252][SQL] Cancel a query when shuffle-write bytes exceed a limit

  #60243·xumingming opened Nov 9, 2026Contributor·

  ·

• [SPARK-61239][SQL] Return NULL for a map subscript key out of the range of the map key type

  #60242·SEPURI-SAI-KRISHNA opened Nov 9, 2026Contributor·

  ·

• [SPARK-51692][SQL] Keep the dynamic pruning subquery when deduplicating a copied CTE body

  #60241·akupchinskiy opened Nov 9, 2026·

  ·

• [SPARK-61248][SQL] Close the spill readers of the sort-merge ASOF join's buffered scan

  #60240·LukaZdravic opened Nov 9, 2026Contributor·

  ·
  4

• [SPARK-61247][SQL] Fix ASOF join results for a NOT NULL left ON key and a nullable right ON key

  #60239·LukaZdravic opened Nov 9, 2026Contributor·

  ·
  1

• [PS] Fix DateOffset imports with pandas 3.1

  #60238·zhengruifeng opened Nov 9, 2026Contributor·

  ·

• [WIP][INFRA] Install PyArrow in the Python 3.15 CI image

  #60237·zhengruifeng opened Nov 9, 2026Contributor·

  ·

• [SPARK-61232][SQL] UnionExec whole-stage codegen fails when a child output repeats an ExprId

  #60236·ulysses-you opened Nov 9, 2026Contributor·

  ·
  4

• [SPARK-61032][SQL] Do not push TopN to MySQL when ONLY_FULL_GROUP_BY rejects its sort keys

  ai-review-requested
  #60235·aleksandar-trajkovic-db opened Nov 9, 2026Contributor·

  ·
  4

• [SPARK-61210][SQL] Avoid redundant null-bit tracking on a vectorized column's byte-data child

  #60234·wangyum opened Nov 9, 2026Member·

  ·
  5

• [SPARK-60594][PYTHON] Treat NaN partition keys as equal when splitting Python UDTF TABLE argument partitions

  #60233·CODERNSINGH opened Nov 9, 2026·

  ·
  1

• [SPARK-61213][PYTHON] Convert non-string property values to strings in Catalog.createDatabase

  #60232·kjs1095 opened Nov 9, 2026Contributor·

  ·
  1

• [SPARK-61274][PYTHON] Clamp awaitTermination's sub-millisecond timeout to 1ms

  #60230·AlejandroMorgante opened Nov 9, 2026·

  ·
  7

• [SPARK-60965][SQL] Make code for excluding tables from shared relation cache generic

  #60229·aokolnychyi opened Nov 8, 2026Contributor·

  ·
  1

• [SPARK-61273][PYTHON] Reject nan/inf timeouts with a proper PySpark error

  #60228·AlejandroMorgante opened Nov 8, 2026·

  ·
  8