Releases: GoogleCloudDataproc/dataproc-spark-connect-python
Releases · GoogleCloudDataproc/dataproc-spark-connect-python
v1.0.1
05 Dec 19:25
Compare
Sorry, something went wrong.
No results found
1.0.1 (2025-12-05)
Bug Fixes
Switch to pyspark package as a dependency (#170 ) (9b0e306 )
v1.0.0
04 Dec 18:22
Compare
Sorry, something went wrong.
No results found
1.0.0 (2025-12-04)
Bug Fixes
Add validation when location or project ID are not provided (#168 ) (8da16ed )
v1.0.0rc7
14 Nov 01:47
Compare
Sorry, something went wrong.
No results found
Features
Depend on the lightweight Spark Connect client (#166 ) (89d77af )
support sharable session termination by adding terminate option to stop() function (#162 ) (3beb0fc )
Bug Fixes
address the error display issue on workbench only (#154 ) (538b7ca )
Do not manually set already pre-defined Spark BQ Connector configs (#165 ) (3403ce7 )
Do not print stacktrace for known errors in all IPython envs (#159 ) (c693b63 )
error (stack trace) propagation in non-Colab IPython environments (#158 ) (1988c42 )
Remove 'Dataproc Session' link from the cell output and update 'View Session Details' button url. (#163 ) (43b696c )
Remove redundant empty/non-actionable per-operation Spark UI link and progress bar (#157 ) (7059ecc )
Update Python version mapping for Dataproc runtime 3.0 to Python 3.12 (#155 ) (16e98e3 )
Use CLI tqdm if ipywidgets not installed (#167 ) (a0d2551 )
v1.0.0rc6
13 Oct 05:20
Compare
Sorry, something went wrong.
No results found
Features
Add support for running Spark Connect client inside the Dataproc s8s batch (#150 ) (e5b1708 )
add support for sparksql magic (#137 ) (274f013 )
Bug Fixes
Ensure DataprocSparkConnectException displays error messages in all Jupyter environments (#136 ) (1fc26f5 )
pysparkvalue error (#144 ) (436d97e )
Revert the exception message fix in SC 1.0 (#147 ) (21b6239 )
v1.0.0rc5
19 Sep 17:32
Compare
Sorry, something went wrong.
No results found
Bug Fixes
Automatically set authentication type to SERVICE_ACCOUNT when a service account is provided (#139 ) (ee1d237 )
v1.0.0rc4
29 Aug 02:26
Compare
Sorry, something went wrong.
No results found
Features
Add custom session ID support and validation for DataprocSparkSession (#132 ) (112574d )
Bug Fixes
Fix session creation display logic and session details button (#134 ) (cd6f813 )
v1.0.0rc3
21 Aug 18:04
Compare
Sorry, something went wrong.
No results found
Features
Add server/client runtime version compatibility check (#128 ) (065cb50 )
Bug Fixes
Fix per-operation Spark UI link display logic (#131 ) (547b2fe )
v1.0.0rc2
18 Aug 21:12
Compare
Sorry, something went wrong.
No results found
v1.0.0rc1
05 Aug 16:57
Compare
Sorry, something went wrong.
No results found
⚠ BREAKING CHANGES
Upgrade to Spark 4 client (#111 )
Features
v0.9.0
01 Aug 14:46
Compare
Sorry, something went wrong.
No results found
0.9.0 (2025-07-31)
Features
add builder methods for session configuration (#115 ) (3a6a218 )
Add Python version check and warning (#114 ) (65e8d4d )
Add view session details button (#123 ) (01b8f05 )
Refactor and centralize client environment detection (#117 ) (3b1a0a0 )
Bug Fixes
Detect only IDE (not plugins) in the environment.py (#125 ) (4733981 )