Skip to content

Updated spark-submit command#56

Open
Maryom wants to merge 1 commit intocitiususc:masterfrom
Maryom:master
Open

Updated spark-submit command#56
Maryom wants to merge 1 commit intocitiususc:masterfrom
Maryom:master

Conversation

@Maryom
Copy link

@Maryom Maryom commented Jan 20, 2018

Hi,

Thanks for your repo.

I got the following warning:

Warning: Master yarn-cluster is deprecated since 2.0. Please use master "yarn" with specified deploy mode instead.

According to this doc we have to write yarn instead of yarn-cluster. So, I updated the spark-submit in readme and and I also wrote the --deploy-mode cluster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant