Skip to content

Releases: GoogleCloudDataproc/dataproc-spark-connect-python

v1.0.1

05 Dec 19:25
9228492

Choose a tag to compare

1.0.1 (2025-12-05)

Bug Fixes

  • Switch to pyspark package as a dependency (#170) (9b0e306)

v1.0.0

04 Dec 18:22
7121200

Choose a tag to compare

1.0.0 (2025-12-04)

Bug Fixes

  • Add validation when location or project ID are not provided (#168) (8da16ed)

v1.0.0rc7

14 Nov 01:47
7af8498

Choose a tag to compare

v1.0.0rc7 Pre-release
Pre-release

1.0.0rc7 (2025-11-13)

Features

  • Depend on the lightweight Spark Connect client (#166) (89d77af)
  • support sharable session termination by adding terminate option to stop() function (#162) (3beb0fc)

Bug Fixes

  • address the error display issue on workbench only (#154) (538b7ca)
  • Do not manually set already pre-defined Spark BQ Connector configs (#165) (3403ce7)
  • Do not print stacktrace for known errors in all IPython envs (#159) (c693b63)
  • error (stack trace) propagation in non-Colab IPython environments (#158) (1988c42)
  • Remove 'Dataproc Session' link from the cell output and update 'View Session Details' button url. (#163) (43b696c)
  • Remove redundant empty/non-actionable per-operation Spark UI link and progress bar (#157) (7059ecc)
  • Update Python version mapping for Dataproc runtime 3.0 to Python 3.12 (#155) (16e98e3)
  • Use CLI tqdm if ipywidgets not installed (#167) (a0d2551)

v1.0.0rc6

13 Oct 05:20
356d9b7

Choose a tag to compare

v1.0.0rc6 Pre-release
Pre-release

1.0.0rc6 (2025-10-10)

Features

  • Add support for running Spark Connect client inside the Dataproc s8s batch (#150) (e5b1708)
  • add support for sparksql magic (#137) (274f013)

Bug Fixes

  • Ensure DataprocSparkConnectException displays error messages in all Jupyter environments (#136) (1fc26f5)
  • pysparkvalue error (#144) (436d97e)
  • Revert the exception message fix in SC 1.0 (#147) (21b6239)

v1.0.0rc5

19 Sep 17:32
30e22bb

Choose a tag to compare

v1.0.0rc5 Pre-release
Pre-release

1.0.0rc5 (2025-09-19)

Bug Fixes

  • Automatically set authentication type to SERVICE_ACCOUNT when a service account is provided (#139) (ee1d237)

v1.0.0rc4

29 Aug 02:26
775e4cb

Choose a tag to compare

v1.0.0rc4 Pre-release
Pre-release

1.0.0rc4 (2025-08-28)

Features

  • Add custom session ID support and validation for DataprocSparkSession (#132) (112574d)

Bug Fixes

  • Fix session creation display logic and session details button (#134) (cd6f813)

v1.0.0rc3

21 Aug 18:04
be29ea6

Choose a tag to compare

v1.0.0rc3 Pre-release
Pre-release

1.0.0rc3 (2025-08-21)

Features

  • Add server/client runtime version compatibility check (#128) (065cb50)

Bug Fixes

  • Fix per-operation Spark UI link display logic (#131) (547b2fe)

v1.0.0rc2

18 Aug 21:12
a565b7b

Choose a tag to compare

v1.0.0rc2 Pre-release
Pre-release

1.0.0rc2 (2025-08-18)

Features

  • Per-operation execution progress bar (#129) (ba68104)

v1.0.0rc1

05 Aug 16:57
0026c3f

Choose a tag to compare

v1.0.0rc1 Pre-release
Pre-release

1.0.0rc1 (2025-08-05)

⚠ BREAKING CHANGES

  • Upgrade to Spark 4 client (#111)

Features

v0.9.0

01 Aug 14:46
3b7df0d

Choose a tag to compare

0.9.0 (2025-07-31)

Features

  • add builder methods for session configuration (#115) (3a6a218)
  • Add Python version check and warning (#114) (65e8d4d)
  • Add view session details button (#123) (01b8f05)
  • Refactor and centralize client environment detection (#117) (3b1a0a0)

Bug Fixes

  • Detect only IDE (not plugins) in the environment.py (#125) (4733981)