More submit configuration with 'spark.yarn.am.nodeLabelExpression'

[xiandong79]

I want to submit with a new configuration:

conf spark.yarn.am.nodeLabelExpression="my-label"

spark-bench = {
  spark-submit-config = [{
spark-home = "/usr/lib/spark"
conf spark.yarn.am.nodeLabelExpression="Y"
    workload-suites = [
      {
        descr = "One run of SparkPi and that's it!"
benchmark-output = "hdfs:///tmp/results-kmeans.csv"
        repeat = 2
workloads = [
        {
    name = "kmeans"
    input = "hdfs:///tmp/kmeans-data.csv"
    k = 10
maxiterations=10
  }]
      }
    ]
  }]
}

How should I revise the above conf ?

[xiandong79]

The above line would be parsed as:

--conf spark
{yarn={am={nodeLabelExpression=my-label}}}

[xiandong79]

spark-args = {
spark.yarn.am.nodeLabelExpression = "my-label"
}

Failed!!

@ecurtin