This sample shows how to leverage the spark-sklearn package in parallel to perform parameter sweep on Spark worker nodes, and compare that with the regular parameter sweep performed in scikit-learn.
It also shows how to add published Spark packages to your project using the Spark_dependencies.yml file in the aml_config folder.