Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
461 commits
Select commit Hold shift + click to select a range
a157725
[SPARK-55011][DOCS] CURSORs docs
srielau Jan 29, 2026
23afba2
[SPARK-55282][PYTHON][CONNECT] Avoid using worker_util in the Driver-…
ueshin Jan 30, 2026
9254e89
[SPARK-55263][PYTHON][INFRA] Upgrade Python linter from 3.11 to 3.12 …
Yicong-Huang Jan 30, 2026
6625591
[SPARK-55281][PYTHON] Add ipykernel and IPython to mypy optional pack…
gaogaotiantian Jan 30, 2026
ea26cac
[SPARK-55266][INFRA] Add pre-commit hooks for format/lint
gaogaotiantian Jan 30, 2026
86f8b3f
[SPARK-55276][BUILD] Upgrade `scala-maven-plugin` to 4.9.9
dongjoon-hyun Jan 30, 2026
b3cbff3
[SPARK-55272][BUILD] Upgrade SBT to 1.12.1
LuciferYang Jan 30, 2026
4344f3f
[SPARK-55273][SQL] Replace `ParquetFileReader.open().getFooter()` wit…
LuciferYang Jan 30, 2026
75cd9be
[SPARK-55237][SQL] Suppress annoying messages when looking up nonexis…
pan3793 Jan 30, 2026
4729b99
[SPARK-55031][SQL] Add vector avg/sum aggregation function expressions
zhidongqu-db Jan 30, 2026
8e65769
[SPARK-55236][CORE] Address unexpected exception in some CoarseGraine…
ChuckLin2025 Jan 30, 2026
efdb492
[SPARK-55277][SQL] Add `protobuf_funcs` group for Protobuf SQL functions
yaooqinn Jan 30, 2026
4a58b84
Revert "[SPARK-55277][SQL] Add `protobuf_funcs` group for Protobuf SQ…
yaooqinn Jan 30, 2026
4e05372
[SPARK-55277][SQL] Add `protobuf_funcs` group for Protobuf SQL functions
yaooqinn Jan 30, 2026
44db44c
[SPARK-49110][SQL] Simplify SubqueryAlias.metadataOutput to always pr…
cloud-fan Jan 30, 2026
1da0e53
[SPARK-55133][CONNECT] Fix race condition in IsolatedSessionState lif…
cloud-fan Jan 30, 2026
04b821c
[SPARK-55256][SQL] Support IGNORE NULLS / RESPECT NULLS for array_agg…
yaooqinn Jan 30, 2026
76f6c78
[SPARK-55239][CONNECT][YARN] Allow to launch SparkConnectServer in YA…
sarutak Jan 30, 2026
fbb4019
[SPARK-55279][SQL] Add `sketch_funcs` group for DataSketches SQL func…
yaooqinn Jan 30, 2026
65a6a55
[SPARK-55246][SS] Add Test for Pyspark TWS and TWSInPandas and Fix St…
zifeif2 Jan 31, 2026
866a6e8
[SPARK-55290][NETWORK][TESTS] Fix testReloadMissingTrustStore cross-d…
efaracci018 Jan 31, 2026
2d94091
[SPARK-55193][CORE][BUILD] Use `CompressionHandler` as a replacement …
LuciferYang Jan 31, 2026
c5cb243
[SPARK-55123][SS] Add SequentialUnionOffset for tracking sequential s…
ericm-db Feb 1, 2026
1ce1102
[SPARK-55105][SS] Add Integration Test for Join Operator
zifeif2 Feb 1, 2026
545d9e7
[SPARK-55287][INFRA] Consolidate steps in `lint`
zhengruifeng Feb 1, 2026
a3e3da9
[SPARK-55176][PYTHON] Extract `arrow_to_pandas` converter into ArrowA…
Yicong-Huang Feb 1, 2026
9b6393d
[SPARK-55284][PYTHON][TEST] Move mypy-data related configs to the script
gaogaotiantian Feb 1, 2026
fbc3471
[SPARK-55285][SQL][PYTHON] Fix the initialization of `PythonArrowInput`
zhengruifeng Feb 1, 2026
2d41e46
[SPARK-55283][PYTHON][PS][TESTS] Add a new argument ignore_null to as…
gaogaotiantian Feb 1, 2026
0aeb6f9
[SPARK-55286][INFRA] Add test summary to GitHub Actions for better fa…
yaooqinn Feb 1, 2026
b7c00ea
[SPARK-55293][PS][TESTS] Avoid using old offset aliases
ueshin Feb 1, 2026
f74d7be
[SPARK-55093][CORE] Handle TaskRunner construction failures in launch…
Feb 2, 2026
36fbc71
[SPARK-55297][PYTHON][PS] Restore timedelta dtype based on the origin…
gaogaotiantian Feb 2, 2026
d3dc602
[SPARK-55307][K8S][INFRA] Update `setup-minikube` to v0.0.21
dongjoon-hyun Feb 2, 2026
3fa07bb
[SPARK-55305][SQL][TESTS] Use `ParquetFooterReader.readFooter` unifor…
LuciferYang Feb 2, 2026
3026926
[SPARK-55289][SQL] Fix flaky test in-set-operations.sql by disabling …
yaooqinn Feb 2, 2026
7792122
[SPARK-55260][GEO][SQL] Implement Parquet write support for Geo types
uros-db Feb 2, 2026
15c6849
[SPARK-55285][SQL][PYTHON][FOLLOW-UP] Code clean up
zhengruifeng Feb 2, 2026
c94ce2c
[SPARK-55302][SQL] Fix custom metrics in case of `KeyGroupedPartition…
peter-toth Feb 2, 2026
22094fe
[SPARK-55161][PYTHON] Support profilers on python data source
gaogaotiantian Feb 2, 2026
0c041c2
[SPARK-55224][PYTHON] Use Spark DataType as ground truth in Pandas-Ar…
Yicong-Huang Feb 3, 2026
60c8c3f
[SPARK-55176][PYTHON][FOLLOW-UP] Fix `_input_type` and `_arrow_cast` …
Yicong-Huang Feb 3, 2026
7b242f2
[SPARK-55318] Performance Optimizations for vector_avg/vector_sum
zhidongqu-db Feb 3, 2026
30ace9f
[SPARK-55309][BUILD] Upgrade protobuf to 33.5
LuciferYang Feb 3, 2026
8ffd150
[SPARK-55293][PS][TESTS][FOLLOW-UP] Avoid more old offset aliases
ueshin Feb 3, 2026
7a8bad7
[SPARK-55319][PYTHON][INFRA] Add libjpeg-dev to pypy dockerfile
gaogaotiantian Feb 3, 2026
4235048
[SPARK-55323][PYTHON] Move UDF metadata to EvalConf to simplify worke…
gaogaotiantian Feb 3, 2026
11d3fec
[SPARK-55315][PYTHON][TESTS] Allow eventually to take custom exceptions
gaogaotiantian Feb 3, 2026
14bc852
[SPARK-55313][PYTHON] Do not activate conda environment when installi…
gaogaotiantian Feb 3, 2026
2b9c1fb
[SPARK-55327][K8S] Reduce Spark docker image sizes
dongjoon-hyun Feb 3, 2026
917baea
[SPARK-55328][SQL][PYTHON] Reuse PythonArrowInput.codec in GroupedPyt…
zhengruifeng Feb 3, 2026
3f5fd65
[SPARK-54969][PYTHON] Implement new arrow->pandas conversion
zhengruifeng Feb 3, 2026
cc2ecef
[SPARK-55320][SQL][CONNECT] Use raise_error instead of divide by zero…
heyihong Feb 3, 2026
7b673d6
[SPARK-55308][BUILD] Upgrade icu4j to 78.2
LuciferYang Feb 3, 2026
a7bc395
[SPARK-55295][GEO][CONNECT][PYTHON][SQL] Extend the ST_GeomFromWKB fu…
uros-db Feb 3, 2026
9788c52
[SPARK-55258][DOCS] Document CLI parameters in declarative pipelines …
sryza Feb 3, 2026
f9cc3dd
[SPARK-55106][SS] Add Repartition Integration test for TransformWithS…
zifeif2 Feb 3, 2026
a263a5e
[SPARK-55280][CONNECT] Add GetStatus proto to support execution statu…
Feb 3, 2026
5648458
[SPARK-55342][K8S] Fix `ExecutorPodsLifecycleEventHandler` to `Execut…
dongjoon-hyun Feb 3, 2026
455ea6c
[SPARK-55040][PYTHON][FOLLOW-UP] Always pass secret for taskcontext
gaogaotiantian Feb 3, 2026
b91d407
[SPARK-55336][PYTHON] Let createDF use create_batch logic for decoupling
Yicong-Huang Feb 3, 2026
5802a78
[SPARK-55313][PYTHON][FOLLOW-UP] Do not auto-activate conda for CI
gaogaotiantian Feb 3, 2026
6aafdc1
[SPARK-55309][BUILD][FOLLOW-UP] Bump container protobuf version
gaogaotiantian Feb 4, 2026
78d9eae
[SPARK-54599][PYTHON] Refactor PythonException so it can take errorCl…
gaogaotiantian Feb 4, 2026
ca1e3e7
[MINOR][PYTHON][TESTS] Skip the doctest of toJSON
zhengruifeng Feb 4, 2026
663a6c4
[SPARK-55351][PYTHON][SQL] PythonArrowInput encapsulate resource allo…
zhengruifeng Feb 4, 2026
b03c69c
[SPARK-55346][INFRA][PYTHON] Upgrade pystack version to 1.6.0 and ins…
gaogaotiantian Feb 4, 2026
f8526b6
[MINOR][PYTHON][TESTS] Fix `test_time_zone_against_map_in_arrow` for …
zhengruifeng Feb 4, 2026
4c19158
Revert "[SPARK-55351][PYTHON][SQL] PythonArrowInput encapsulate resou…
zhengruifeng Feb 4, 2026
16f639f
[SPARK-55354][CORE][DOCS] Fix `ExecutorAllocationClient` comment to i…
dongjoon-hyun Feb 4, 2026
fac11c4
[SPARK-55291][CONNECT] Pre-process metadata headers at client interce…
heyihong Feb 4, 2026
f9b712a
[MINOR] Remove python version requirements for scipy-stubs
gaogaotiantian Feb 4, 2026
620b2f6
[SPARK-55362][PYTHON][CONNECT] Don't wait for threadpool shutdown
gaogaotiantian Feb 4, 2026
0437a93
[SPARK-55340][SQL] Add helper for name to data type
leonwind Feb 5, 2026
508130f
[SPARK-55086][PYTHON] Add DataSourceReader.pushFilters to Python Data…
yamayuki-hub Feb 5, 2026
bb98d4d
[SPARK-46165][PS] Add support for DataFrame.all axis=None
devin-petersohn Feb 5, 2026
73c3513
[SPARK-55350][PYTHON][CONNECT] Fix row count loss when creating DataF…
Yicong-Huang Feb 5, 2026
ebc24e0
[SPARK-55363][PS][TESTS] Make ops tests with "decimal_nan" columns ig…
ueshin Feb 5, 2026
45879b7
[SPARK-55313][PYTHON][FOLLOW-UP] Only add condabin to PATH for pip tests
gaogaotiantian Feb 5, 2026
d9dc3c1
[SPARK-55335][PYTHON][TESTS] Use eventually instead of hard-coded wai…
gaogaotiantian Feb 5, 2026
481f986
[SPARK-55303][PYTHON][TESTS] Extract GoldenFileTestMixin for type coe…
Yicong-Huang Feb 5, 2026
612ade4
[SPARK-54805][SS][PYTHON] Implement TwsTester in PySpark
Feb 5, 2026
214bf95
[SPARK-55153][SS][PYTHON][DOC] Add documentation for TwsTester
Feb 5, 2026
efe9b53
Revert "[SPARK-55313][PYTHON][FOLLOW-UP] Only add condabin to PATH fo…
gaogaotiantian Feb 5, 2026
7a4bb46
[SPARK-55359][CORE] Promote `TaskResourceRequest` to `Stable`
dongjoon-hyun Feb 5, 2026
52b327f
[SPARK-55360][BUILD] Upgrade sbt to `1.12.2`
sarutak Feb 5, 2026
b58fdcd
[SPARK-55364][PYTHON] Make SupportsIAdd and SupportsOrdering protocol…
gaogaotiantian Feb 5, 2026
7d3b322
[SPARK-55175][PYTHON] Extract `to_pandas` transformer from serializers
Yicong-Huang Feb 5, 2026
c28d7ad
Revert "[SPARK-55175][PYTHON] Extract `to_pandas` transformer from se…
zhengruifeng Feb 5, 2026
43d332d
[SPARK-55228][SPARK-55230][SQL][CONNECT] Implement Dataset.zipWithInd…
fangchenli Feb 5, 2026
fd37671
[SPARK-55365][PYTHON] Generalize the utils for arrow array conversion
zhengruifeng Feb 5, 2026
ec90eb0
[SPARK-55356][SQL] Support alias for PIVOT clause
filipdavidovic Feb 5, 2026
1a93d55
[SPARK-55341][SQL] Add storage level flag for cached local relations
pranavdev022 Feb 5, 2026
3298e68
[SPARK-55373][CONNECT] Improve noHandlerFoundForExtension error message
khakhlyuk Feb 5, 2026
cae4e2a
[SPARK-55370][K8S] Improve `annotateExecutorDeletionCost` to use `pat…
dongjoon-hyun Feb 5, 2026
54a9d4e
[MINOR][PS] Convert loop append in Pyspark to list comprehension
devin-petersohn Feb 5, 2026
c3ceae4
[SPARK-55366][SQL][PYTHON] Remove `errorOnDuplicatedFieldNames` from …
zhengruifeng Feb 5, 2026
62824a8
[SPARK-55368][PYTHON][TESTS] Make sure `worker_util.py` can only be i…
zhengruifeng Feb 5, 2026
509aa00
[SPARK-55345][PYTHON][PS] Do not pass unit and closed to Timedelta fo…
gaogaotiantian Feb 5, 2026
5de75d8
[SPARK-55175][PYTHON] Extract `to_pandas` transformer from serializers
Yicong-Huang Feb 5, 2026
a48e313
[SPARK-55377][K8S] Improve `labelDecommissioningExecs` to use `patch`…
dongjoon-hyun Feb 6, 2026
b28db40
[SPARK-55363][PS][TESTS][FOLLOW-UP] Also fix `test_num_mul_div` to ig…
ueshin Feb 6, 2026
9900398
[MINOR][PYTHON] Add `tabulate` in `dev/requirements.txt`
zhengruifeng Feb 6, 2026
7946e2c
[SPARK-55382][CORE] Make `Executor` to log `Running Spark version`
dongjoon-hyun Feb 6, 2026
0bcf997
[SPARK-55376][PS] Make numeric_only argument in groupby functions acc…
ueshin Feb 6, 2026
f0d9f99
[SPARK-55386][INFRA] Run `Java 17/25` Maven install tests on PR build…
dongjoon-hyun Feb 6, 2026
861ba53
[SPARK-55300][DOCS] Add timestamp offset option visualization in Kafk…
kavpreetgrewal Feb 6, 2026
ee32469
[SPARK-55358][PYTHON][INFRA] Upgrade Python 3.12 test image to Ubuntu…
zhengruifeng Feb 6, 2026
ec29abb
[SPARK-55379][PS][TESTS] Add some ops tests back and their parity tests
ueshin Feb 6, 2026
9bc9fac
[SPARK-55334][PYTHON] Enable `TimestampType` and `TimestampNTZType` i…
zhengruifeng Feb 6, 2026
b2601be
[SPARK-55131][SS] Change the default merge operator delimiter for Roc…
HeartSaVioR Feb 6, 2026
b75a329
[SPARK-55317][SQL] Add SequentialUnion logical plan node and planning…
ericm-db Feb 6, 2026
cbcc7f8
[SPARK-55304][SS][PYTHON] Introduce support of Admission Control and …
HeartSaVioR Feb 7, 2026
bbd8fd6
[SPARK-55399][K8S] Improve `KubernetesDriverEndpoint` to use `patch` …
dongjoon-hyun Feb 7, 2026
ac28263
[SPARK-55391][PYTHON][INFRA] Upgrade Python 3.13 test image to Ubuntu…
zhengruifeng Feb 7, 2026
4d3094f
[SPARK-55392][PYTHON][INFRA] Upgrade Python 3.14 test image to Ubuntu…
zhengruifeng Feb 7, 2026
9268812
[SPARK-55393][PYTHON][INFRA] Upgrade Python 3.11 test image to Ubuntu…
zhengruifeng Feb 7, 2026
3405255
[SPARK-55394][PYTHON][INFRA] Upgrade Python 3.10 test image to Ubuntu…
zhengruifeng Feb 7, 2026
4e86ae4
[SPARK-55387][CORE][UI] Fix DAG visualization not rendering due to ma…
yaooqinn Feb 7, 2026
3a9307f
[SPARK-55401][PYTHON] Add retry logic and timeout handling to pyspark…
yaooqinn Feb 7, 2026
767be89
[MINOR][DOCS] Update Maven version and MAVEN_OPTS setting in `buildin…
dongjoon-hyun Feb 7, 2026
8c72eff
[SPARK-55180][PYTHON][INFRA][FOLLOW-UP] Delete unused yml file
zhengruifeng Feb 7, 2026
252f6a4
[SPARK-55410][K8S] Improve `SparkKubernetesDiagnosticsSetter` to use …
dongjoon-hyun Feb 8, 2026
de34528
[SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20 for all GitHu…
dongjoon-hyun Feb 8, 2026
474e07e
[SPARK-55412][PYTHON][INFRA] Upgrade Python 3.14 no gil test image to…
zhengruifeng Feb 8, 2026
a1c41a8
[SPARK-55403][PS] Fix `no attribute 'draw'` error in the plot tests w…
ueshin Feb 8, 2026
bd84198
[SPARK-55420][BUILD] Upgrade Netty to `4.2.10.Final`
dongjoon-hyun Feb 8, 2026
db28b99
[SPARK-55337][SS] Fix MemoryStream backward compatibility
cloud-fan Feb 8, 2026
56b4a2d
[SPARK-54881][SQL][FOLLOWUP] Extract simplifyNot method in BooleanSim…
cloud-fan Feb 8, 2026
2092221
[SPARK-55407][PYSPARK] Replace logger.warn with logger.warning
gaogaotiantian Feb 8, 2026
df8d8dd
[SPARK-55428][BUILD] Sync Netty Java options everywhere
pan3793 Feb 8, 2026
d1dbcda
[SPARK-55413][PYTHON][INFRA] Upgrade Python minimum dep test images t…
zhengruifeng Feb 8, 2026
e72ddac
[SPARK-55415][PYTHON][INFRA] Upgrade PyPy images to Ubuntu 24.04
zhengruifeng Feb 8, 2026
71f5147
[SPARK-55383][INFRA] Only send test report to codecov in coverage run
gaogaotiantian Feb 8, 2026
8ec9d49
[SPARK-55385][CORE][SQL] Mitigate the recomputation in `zipWithIndex`
zhengruifeng Feb 8, 2026
e2e4054
[SPARK-55395][SQL] Disable RDD cache in `DataFrame.zipWithIndex`
zhengruifeng Feb 8, 2026
4c33689
[SPARK-55404][PYTHON] Always raise KeyboardInterrupt from SIGINT handler
gaogaotiantian Feb 8, 2026
d544988
[SPARK-55406][PYTHON][CONNECT] Reimplement the thread pool for Execut…
gaogaotiantian Feb 8, 2026
668b2c5
[SPARK-55409][PS] Handle an unexpected keyword argument error from re…
ueshin Feb 8, 2026
6ab3c80
[SPARK-55358][PYTHON][INFRA][FOLLOW-UP] Do not apt-get install `pytho…
zhengruifeng Feb 8, 2026
1ad2db2
[SPARK-55414][PYTHON][INFRA] Upgrade Python 3.12 test images for clas…
zhengruifeng Feb 8, 2026
795f768
[SPARK-55175][PYTHON][FOLLOW-UP] Remove unused `arrow_to_pandas` method
zhengruifeng Feb 8, 2026
7577ec3
[SPARK-55424][PYTHON] Explicitly pass the series name in `convert_numpy`
zhengruifeng Feb 8, 2026
65bdfd7
[SPARK-55429][K8S][TESTS] Improve `VolcanoTestsSuite` to use `Server-…
dongjoon-hyun Feb 8, 2026
63f1f96
Revert "[SPARK-54860][INFRA] Add JIRA Ticket Validating in GHA"
HyukjinKwon Feb 8, 2026
0534f98
[SPARK-54860][INFRA] Followup of the revert to set the permission cor…
HyukjinKwon Feb 8, 2026
ee58e0e
[SPARK-55433][INFRA] Remove labeler in GitHub Actions
HyukjinKwon Feb 8, 2026
f6031fe
[SPARK-55434][INFRA] Add username and password at svn with rm at fina…
HyukjinKwon Feb 9, 2026
26384d7
[SPARK-55224][PYTHON][FOLLOWUP] Remove redundant `use_legacy_pandas_u…
Yicong-Huang Feb 9, 2026
8d46ddb
[SPARK-55405][PYTHON][TESTS] Change tests for pa.Array.cast to use go…
Yicong-Huang Feb 9, 2026
8fb1d2d
[SPARK-55408][PS] Handle unexpected keyword argument errors related t…
ueshin Feb 9, 2026
b6eafcf
[SPARK-55431][K8S] Set `resizePolicy` to `NotRequired` explicitly for…
dongjoon-hyun Feb 9, 2026
eaa3378
[SPARK-55366][SQL][PYTHON][FOLLOW-UP] Relax the duplicated field name…
zhengruifeng Feb 9, 2026
3b5b8a6
[MINOR][INFRA] Use `lsb_release -a` to display the container os version
zhengruifeng Feb 9, 2026
2121a5a
[SPARK-55436][INFRA] Upgrade lint and doc test images to Ubuntu 24.04
zhengruifeng Feb 9, 2026
f3ad0f6
[SPARK-55435][CORE][SQL] Use `StringBuilder` instead of `StringBuffer`
LuciferYang Feb 9, 2026
75afa8e
[SPARK-55229][SPARK-55231][PYTHON] Implement DataFrame.zipWithIndex i…
fangchenli Feb 9, 2026
a6787fd
[SPARK-55437][INFRA][R] Upgrade SparkR test image to Ubuntu 24.04
zhengruifeng Feb 9, 2026
6757f78
[SPARK-55446][PYTHON][INFRA] Upgrade python to 3.12 in UDS/noANSI/Roc…
zhengruifeng Feb 9, 2026
1fca621
[SPARK-55432][K8S] Support built-in K8s `ExecutorResizePlugin`
dongjoon-hyun Feb 9, 2026
605305b
[SPARK-55402][SS] Move streamingSourceIdentifyingName from CatalogTab…
ericm-db Feb 9, 2026
378e74a
[SPARK-55455][BUILD] Upgrade `RoaringBitmap` to 1.6.0
dongjoon-hyun Feb 9, 2026
b4b8165
[SPARK-55355][PYTHON] Upgrade mypy version to the latest
gaogaotiantian Feb 9, 2026
deb09ee
[SPARK-55385][CORE][SQL][FOLLOWUP] Rename preservesDistribution to pr…
cloud-fan Feb 10, 2026
d353b47
[SPARK-55369][SPARK-55332][PYTHON][INFRA] Setup ASV benchmark
fangchenli Feb 10, 2026
3cf6e6b
[SPARK-55456][BUILD] Upgrade `zstd-jni` to 1.5.7-7
dongjoon-hyun Feb 10, 2026
238efa1
[SPARK-55459][PYTHON] Fix 3x performance regression in applyInPandas …
Yicong-Huang Feb 10, 2026
7a0abe4
[SPARK-55405][PYTHON][TESTS][FOLLOWUP] Add safe=False tests for PyArr…
Yicong-Huang Feb 10, 2026
8a74912
[SPARK-55457][INFRA] Add `logging.warning` check in ruff
gaogaotiantian Feb 10, 2026
7cb1369
[SPARK-55460][PYTHON] Remove E203 from ruff's ignore list
gaogaotiantian Feb 10, 2026
ebd5b00
[SPARK-55458][PYTHON][TESTS] Apply the new test pattern for newly add…
gaogaotiantian Feb 10, 2026
fbf096e
[SPARK-55411][SQL] SPJ may throw ArrayIndexOutOfBoundsException when …
pan3793 Feb 10, 2026
ecf003c
[SPARK-55451][SQL] Cursors must start collecting results on OPEN, not…
srielau Feb 10, 2026
bda9069
[SPARK-55472][PS] Raise `AttributeError` from methods removed in pand…
ueshin Feb 11, 2026
1f32721
[SPARK-55395][SQL][FOLLOW-UP] Delete obsolete `withSequenceColumn`
zhengruifeng Feb 11, 2026
93acd1f
[SPARK-55473][PYTHON] Replace itertools.tee with chain in applyInPand…
Yicong-Huang Feb 11, 2026
4192135
[SPARK-55020][PYTHON][FOLLOW-UP] Disable gc only when we communicate …
gaogaotiantian Feb 11, 2026
6ced6b4
[SPARK-55475][BUILD] Disable Maven Parallel PUT
dongjoon-hyun Feb 11, 2026
935e5cd
[SPARK-55367][PYTHON] Use venv for run-pip-tests
gaogaotiantian Feb 11, 2026
39788da
[SPARK-55405][PYTHON][TESTS][FOLLOWUP] Skip PyArrow array cast tests …
Yicong-Huang Feb 11, 2026
04072b1
[MINOR][INFRA] Add `build_infra_images_cache` into `Build Pipeline St…
zhengruifeng Feb 11, 2026
9c45ce4
[MINOR] Remove unused `InMemoryRelation.convertToColumnarIfPossible` …
viirya Feb 11, 2026
52c43ca
[SPARK-55480][PYTHON] Remove all unused noqa for ruff
gaogaotiantian Feb 11, 2026
2a70103
[SPARK-55485][K8S] Add `Constants.POD_DELETION_COST` for reuse
dongjoon-hyun Feb 11, 2026
0c61ccb
[SPARK-55484][K8S] Simplify `KubernetesClusterSchedulerBackend` by re…
dongjoon-hyun Feb 11, 2026
58fbd7f
[SPARK-54173][K8S][FOLLOWUP] Fix `spark.kubernetes.executor.podDeleti…
dongjoon-hyun Feb 11, 2026
6112a0b
[SPARK-52407][SQL][FOLLOW-UP] Remove Theta Sketch aggregation buffer …
Feb 11, 2026
7798054
[SPARK-54179][SQL][FOLLOW-UP] Add Dataframe API support for Tuple ske…
Feb 11, 2026
2538cc8
[SPARK-55490][PS] Make `groupby(as_index=False)` include a grouping t…
ueshin Feb 12, 2026
4e1cb88
[SPARK-54805][SS][PYTHON][FOLLOW-UP] Add test_tws_tester to modules
gaogaotiantian Feb 12, 2026
15ca64d
[SPARK-55483] Fix NPE in PivotFirst when pivot column is a non-atomic…
miland-db Feb 12, 2026
59f3a16
[MINOR][DOCS] Fix several nit issues in documentation
anshulbaliga7 Feb 12, 2026
5b80958
[SPARK-55462][PYTHON] Support UserDefinedType in convert_numpy
fangchenli Feb 12, 2026
17bdbde
[SPARK-55487][PYTHON][TESTS] Detect dangling tests
gaogaotiantian Feb 12, 2026
ad275cc
[SPARK-55498][BUILD][TESTS] Upgrade `oracle-free` docker image to `23…
sarutak Feb 12, 2026
3484a4a
[SPARK-55495][CORE] Fix `EventLogFileWriters.closeWriter` to handle `…
dongjoon-hyun Feb 12, 2026
d5c8a31
[SPARK-54784][ML][DOCS] Document the security policy on ml models
zhengruifeng Feb 12, 2026
3894d06
[SPARK-54740][PYTHON] Start faulthandler early in daemon mode
gaogaotiantian Feb 12, 2026
ac9b01e
[SPARK-55020][PYTHON][FOLLOW-UP] Move release into disable gc protect…
gaogaotiantian Feb 12, 2026
30825c3
[SPARK-55389][PYTHON] Consolidate `SQL_MAP_ARROW_ITER_UDF` wrapper, m…
Yicong-Huang Feb 13, 2026
448681f
[SPARK-55497][BUILD][TESTS] Use `jupyterTestFramework` instead of `Te…
sarutak Feb 13, 2026
ba291a6
[SPARK-55509][K8S][DOCS] Update `YuniKorn` docs with `1.8.0`
dongjoon-hyun Feb 13, 2026
c4935cf
[MINOR][PYTHON] Fix typo: convert_timestample -> convert_timestamp
Yicong-Huang Feb 13, 2026
464f8b5
[SPARK-55156][PS] Deal with `include_groups` for `groupby.apply`
ueshin Feb 13, 2026
991fdc5
[SPARK-55508][BUILD] Upgrade `compress-lzf` to 1.2.0
dongjoon-hyun Feb 13, 2026
4463ba6
[SPARK-55511][K8S][DOCS][INFRA] Upgrade Volcano to 1.14.0
dongjoon-hyun Feb 13, 2026
b11ab86
[SPARK-54805][PYTHON][TESTS][FOLLOW-UP] Skip `TwsTesterTests` in pyth…
zhengruifeng Feb 13, 2026
f391539
[SPARK-54805][PYTHON][TESTS][FOLLOW-UP] Skip `TwsTesterFuzzTests` in …
zhengruifeng Feb 13, 2026
7542473
[SPARK-55416][SS][PYTHON] Streaming Python Data Source memory leak wh…
vinodkc Feb 13, 2026
9c7da4c
[SPARK-55513][BUILD] Upgrade `commons-codec` to 1.21.0
dongjoon-hyun Feb 13, 2026
4a5efe6
[SPARK-55514][BUILD] Upgrade `ammonite` to 3.0.8
dongjoon-hyun Feb 13, 2026
53e759e
[SPARK-55339][GEO][SQL] Implement WKT writer support for Geo objects
uros-db Feb 13, 2026
0db8d05
[SPARK-55449][GEO][SQL] Enable WKB parsing and writing for Geography
uros-db Feb 13, 2026
65db128
[SPARK-55515][BUILD] Upgrade `jjwt` to 0.13.0
dongjoon-hyun Feb 13, 2026
c42f0de
[SPARK-55516][BUILD] Upgrade `ap-loader` to 4.3-12
dongjoon-hyun Feb 13, 2026
a252c5b
[SPARK-55520][TESTS] Regenerate benchmark results
dongjoon-hyun Feb 13, 2026
a0c6265
[SPARK-55517][SQL] Optimize `VectorizedPlainValuesReader.readBytes()`…
LuciferYang Feb 13, 2026
8b83069
[SPARK-55333][PYTHON] Enable `DateType` and `TimeType` in `convert_n…
zhengruifeng Feb 13, 2026
b3e6d97
[SPARK-55385][CORE][SQL][FOLLOW-UP] `getAncestorWithSamePartitionSize…
zhengruifeng Feb 13, 2026
f245941
[SPARK-55524][DOCS] Add `License`, `Java`, and `Maven Central` badges…
dongjoon-hyun Feb 13, 2026
5593f92
[SPARK-55526][WEBUI][TESTS] Add `glob` package to `ui-test`
sarutak Feb 14, 2026
e12bd5a
[SPARK-55522][WEBUI] Allow inline scripts, event handlers and styles …
sarutak Feb 14, 2026
54a6a68
[SPARK-55479][SQL] Fix style issues in SparkShreddingUtils
manuzhang Feb 14, 2026
cc9913b
[SPARK-55129][SS] Introduce new key encoders for timestamp as a first…
HeartSaVioR Feb 15, 2026
1469e0e
[SPARK-55533][SQL] Support IGNORE NULLS / RESPECT NULLS for collect_set
yaooqinn Feb 15, 2026
39fef73
[SPARK-55372][SQL] Fix `SHOW CREATE TABLE` for tables / views with de…
ilicmarkodb Feb 16, 2026
6c8d2ef
[SPARK-55500][SQL] Fix analyzer cycle between `ApplyDefaultCollation`…
ilicmarkodb Feb 16, 2026
bfe1c41
[SPARK-55261][GEO][SQL] Implement Parquet read support for Geo types
uros-db Feb 16, 2026
fcab26b
[SPARK-55541][GEO][SQL] Support Geometry and Geography in catalyst ty…
uros-db Feb 16, 2026
ba75561
[SPARK-55521][CONNECT] Make exception constructors for Spark Connect …
heyihong Feb 16, 2026
9ae77ee
[SPARK-55496][K8S] Support re-use of scaled PVCs
Dzeri96 Feb 16, 2026
d143464
[SPARK-55471] Add optimizer support for SequentialStreamingUnion
ericm-db Feb 17, 2026
c4188b0
[SPARK-55552][SQL] Add VariantType support to ColumnarBatchRow.copy()…
tugce-applied Feb 17, 2026
0931371
[SPARK-55507][PYTHON] Add None check for field.metadata in is_geometr…
Yicong-Huang Feb 17, 2026
eb2c6f0
[SPARK-55279][SQL][FOLLOW-UP] Add sketch_funcs and Datasketch groupin…
Feb 17, 2026
07e9bea
[SPARK-55529][PYTHON] Restore Arrow-level batch merge for non-iterato…
Yicong-Huang Feb 17, 2026
0ab4107
[SPARK-55572][SQL][TESTS] Upgrade `MySQL` image to `9.6.0`
dongjoon-hyun Feb 17, 2026
1fafe9b
[SPARK-55405][PYTHON][TESTS][FOLLOW-UP] Add ARM overrides for float-t…
Yicong-Huang Feb 18, 2026
1e3d116
[SPARK-55506][PYTHON] Pass explicit input schema to `to_pandas` in `C…
Yicong-Huang Feb 18, 2026
f74d3fb
[SPARK-55474][PYTHON][TESTS] Remove test files from ignore list of ruff
gaogaotiantian Feb 18, 2026
5353406
[SPARK-55503][PYTHON][TESTS] Fix and enable test_dl_util.py
gaogaotiantian Feb 18, 2026
20d0c2a
[SPARK-55488][PYTHON][TESTS] Add all dangling test files to modules
gaogaotiantian Feb 18, 2026
e8ab303
[SPARK-55547][INFRA] Enable `GitHub Issues` feature
dongjoon-hyun Feb 18, 2026
89e2a47
[SPARK-55574][SQL][TESTS] Upgrade `MariaDB` JDBC driver to `3.5.7` an…
dongjoon-hyun Feb 18, 2026
ba3c03e
[SPARK-55575][SQL][TESTS] Upgrade `MySQL` JDBC driver to `9.6.0`
dongjoon-hyun Feb 18, 2026
22c1464
[SPARK-55578][SQL][TESTS] Improve `DockerJDBCIntegrationSuite` to sup…
dongjoon-hyun Feb 18, 2026
82a32b0
Attemp to fetch failed block from FallbackStorage
EnricoMi Dec 17, 2024
cda61c6
Replace SparkEnv.get.conf in ShuffleBlockFetcherIterator with optiona…
EnricoMi Jun 12, 2025
8b836fa
Also attempt to recover from Netty OOM error
EnricoMi Mar 3, 2026
b05f163
Fix housekeeping of requests in flight and bytes in flight
EnricoMi Mar 12, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 2 additions & 0 deletions .asf.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@
github:
description: "Apache Spark - A unified analytics engine for large-scale data processing"
homepage: https://spark.apache.org/
features:
issues: true
labels:
- python
- scala
Expand Down
234 changes: 0 additions & 234 deletions .github/labeler.yml

This file was deleted.

1 change: 1 addition & 0 deletions .github/workflows/benchmark.yml
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
fail-fast: false
max-parallel: 20
matrix:
split: ${{fromJSON(needs.matrix-gen.outputs.matrix)}}
env:
Expand Down
Loading
Loading