[submitter]:`lay_out` with `infer_from_ss+` created results for Offline only.

[maria-18-git]

maria@slurm-master:~/work_collection/axs2mlperf_mlperf_6_0/submitter$ axs byname submitter , lay_out --framework=kiss_v --task=text_to_video --division=open --sut_name=b300_n2-kissv --program_name=text_to_video_using_kissv --submitter=Krai --dataset_name=text_to_video --infer_from_ss+
...
maria@slurm-master:~/work_collection/axs2mlperf_mlperf_6_0/submitter$ axs byname submitter , lay_out --framework=kiss_v --task=text_to_video --division=open --sut_name=b300_n2-kissv --program_n
ame=text_to_video_using_kissv --submitter=Krai --dataset_name=text_to_video --infer_from_ss+
INFO:maria@slurm-master param_source.py:touch:376 [submitter] touch _BEFORE_CODE_LOADING=['/home/maria/work_collection/tabulate_package_for_python3.12/install/local/lib/python3.12/dist-packages
']
INFO:maria@slurm-master param_source.py:touch:376 [text_to_video_using_kissv] touch _BEFORE_CODE_LOADING=['/home/maria/work_collection/pyyaml_package_for_python3.12/install/local/lib/python3.12
/dist-packages']

Entry loadgen_output,framework=kiss_v,task=text_to_video,sut_name=b300_n2-kissv,loadgen_mode=AccuracyOnly,loadgen_scenario=Offline is missing, but INFERRABLE, adding it as a mapping

Entry loadgen_output,framework=kiss_v,task=text_to_video,sut_name=b300_n2-kissv,loadgen_mode=PerformanceOnly,loadgen_compliance_test-,loadgen_scenario=Offline is missing, but INFERRABLE, adding
 it as a mapping

Entry loadgen_output,framework=kiss_v,task=text_to_video,sut_name=b300_n2-kissv,loadgen_mode=AccuracyOnly,loadgen_scenario=SingleStream was already PRESENT, adding it to the list

Entry loadgen_output,framework=kiss_v,task=text_to_video,sut_name=b300_n2-kissv,loadgen_mode=PerformanceOnly,loadgen_compliance_test-,loadgen_scenario=SingleStream was already PRESENT, adding i
t to the list
...
        "/usr/bin/python3.12" /home/maria/work_collection/mlperf_inference_git_master/tools/submission/truncate_accuracy_log.py --input /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree --submitter Krai --backup /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/accuracy_log.bak
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
INFO:main:open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline/accuracy/mlperf_log_accuracy.json truncated
INFO:main:open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline/accuracy already has hash and size seems truncated
INFO:main:Make sure you keep a backup of /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/accuracy_log.bak in case mlperf wants to see the original accuracy logs
  Creating SUT description: b300_n2-kissv  -->  /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/systems/b300_n2-kissv.json
/home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree

Results:

maria@slurm-master:~/work_collection/axs2mlperf_mlperf_6_0/submitter$ tree -a /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/
/home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/
├── data_axs.json
└── submitted_tree
    └── open
        └── Krai
            ├── results
            │   └── b300_n2-kissv
            │       └── wan-2.2-t2v-a14b
            │           └── offline
            │               ├── README.md
            │               ├── accuracy
            │               │   ├── accuracy.txt
            │               │   ├── mlperf_log_accuracy.json
            │               │   ├── mlperf_log_detail.txt
            │               │   └── mlperf_log_summary.txt
            │               ├── measurements.json
            │               ├── mlperf.conf
            │               ├── performance
            │               │   └── run_1
            │               │       ├── mlperf_log_detail.txt
            │               │       └── mlperf_log_summary.txt
            │               └── user.conf
            ├── src
            │   └── wan-2.2-t2v-a14b
            │       └── text_to_video_using_kissv
            │           └── README.md
            └── systems
                └── b300_n2-kissv.json

15 directories, 13 files

Directory doesn't contain SingleStream data.

[maria-18-git]

It is an issue with double using scenarios for --infer_from_ss+

    Copying: /home/maria/work_collection/axs2mlperf_mlperf_6_0/text_to_video_using_kissv/README.md  -->  /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_
n2-kissv/submitted_tree/open/Krai/src/wan-2.2-t2v-a14b/text_to_video_using_kissv
DEBUG: scenario =  offline
Experiment: generated_by_text_to_video_using_kissv_on_run_aed2b9f49e6949fabdb0f0add76bbe13 living in /home/maria/work_collection/generated_by_text_to_video_using_kissv_on_run_aed2b9f49e6949fabd
b0f0add76bbe13
  produced_by=axs byquery loadgen_output,task=text_to_video,framework=kiss_v,sut_name=b300_n2-kissv,loadgen_mode=AccuracyOnly,loadgen_scenario=SingleStream,loadgen_target_latency=17.5,nodes=2,n
ode_idx=0,master_addr=slurm-worker-1,hosts=slurm-worker-1,dit_ring_para=8
     mode=Accuracy
Creating directory: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline

DEBUG: scenario =  offline
Experiment: generated_by_text_to_video_using_kissv_on_run_b7efeffca9f7461e8a1e4b7b0c750404 living in /home/maria/work_collection/generated_by_text_to_video_using_kissv_on_run_b7efeffca9f7461e8a
1e4b7b0c750404
  produced_by=axs byquery loadgen_output,task=text_to_video,framework=kiss_v,sut_name=b300_n2-kissv,loadgen_mode=PerformanceOnly,loadgen_scenario=SingleStream,loadgen_target_latency=17.5,nodes=
2,node_idx=0,master_addr=slurm-worker-1,hosts=slurm-worker-1,dit_ring_para=8
     mode=Performance
Creating directory: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline

DEBUG: scenario =  offline
Experiment: generated_by_text_to_video_using_kissv_on_run_aed2b9f49e6949fabdb0f0add76bbe13 living in /home/maria/work_collection/generated_by_text_to_video_using_kissv_on_run_aed2b9f49e6949fabd
b0f0add76bbe13
  produced_by=axs byquery loadgen_output,task=text_to_video,framework=kiss_v,sut_name=b300_n2-kissv,loadgen_mode=AccuracyOnly,loadgen_scenario=SingleStream,loadgen_target_latency=17.5,nodes=2,n
ode_idx=0,master_addr=slurm-worker-1,hosts=slurm-worker-1,dit_ring_para=8
     mode=Accuracy
Creating directory: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline

DEBUG: scenario =  offline
Experiment: generated_by_text_to_video_using_kissv_on_run_b7efeffca9f7461e8a1e4b7b0c750404 living in /home/maria/work_collection/generated_by_text_to_video_using_kissv_on_run_b7efeffca9f7461e8a
1e4b7b0c750404
  produced_by=axs byquery loadgen_output,task=text_to_video,framework=kiss_v,sut_name=b300_n2-kissv,loadgen_mode=PerformanceOnly,loadgen_scenario=SingleStream,loadgen_target_latency=17.5,nodes=
2,node_idx=0,master_addr=slurm-worker-1,hosts=slurm-worker-1,dit_ring_para=8
     mode=Performance
Creating directory: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline

[maria-18-git]

Solution

Need to add Runnable object (inherit parameters from parent_objects (candidate_entry) and changeloadgen_scenario for a child ):

candidate_entry = Runnable(name = "editable_child", parent_objects = [ candidate_entry ], own_data = { substituted_param: target_value }, own_functions=Namespace( get_path=
(lambda file_name, __entry__: __entry__.parent_objects[0].get_path(file_name) ) ), kernel = candidate_entry.get_kernel() )

in submitter/code.axs
and update how to use get_path for experiment_entry

maria@slurm-master:~/work_collection/axs2mlperf_mlperf_6_0$ git diff submitter/code_axs.py
diff --git a/submitter/code_axs.py b/submitter/code_axs.py
index 85ef0fc..12f8f3e 100644
--- a/submitter/code_axs.py
+++ b/submitter/code_axs.py
@@ -7,6 +7,8 @@ import json
 import subprocess
 from ufun import save_json
 from tabulate import tabulate
+from argparse import Namespace
+from runnable import Runnable

 def create_run_verification_input_dict(task, tmp_dir, verify_script_path, results_dir, compliance_dir, output_dir, scenario, dtype=None):
     result_dict = {
@@ -154,7 +156,7 @@ Usage examples:
                     print(f"Entry {joined_query} is missing, but INFERRABLE, adding it as a mapping\n")
                     [ substituted_param, target_value, source_value, inferred_query, inferred_entry ] = inferrable_case
                     candidate_entry = inferred_entry or __entry__.get_kernel().byquery(inferred_query, True)
-                    candidate_entry[substituted_param] = target_value
+                    candidate_entry = Runnable(name = "editable_child", parent_objects = [ candidate_entry ], own_data = { substituted_param: target_value }, own_functions=Namespace( get_path=
(lambda file_name, __entry__: __entry__.parent_objects[0].get_path(file_name) ) ), kernel = candidate_entry.get_kernel() )
                 else:
                     if candidate_entry:
                         print(f"Entry {joined_query} was already PRESENT, adding it to the list\n")
@@ -194,7 +196,7 @@ def make_local_dir( path_list, submitted_tree_path ):

 def get_testing_entry(experiment_entry):

-    entry_path = experiment_entry.get_path("")
+    entry_path = experiment_entry.call("get_path", [""])
     path_to_program_output = os.path.join(entry_path, 'program_output.json')

     with open(path_to_program_output, 'r') as file:
@@ -237,7 +239,7 @@ def lay_out(experiment_entries, division, submitter, log_truncation_script_path,
         experiment_program_name  = experiment_entry.get('program_name')
         program_entry = __entry__.get_kernel().byname(experiment_program_name)

-        src_dir = experiment_entry.get_path("")
+        src_dir = experiment_entry.call("get_path", [""])

         sut_name        = experiment_entry.get('sut_name')
         sut_description = experiment_entry.get('sut_description')
@@ -299,7 +301,7 @@ def lay_out(experiment_entries, division, submitter, log_truncation_script_path,
                 shutil.copy( src_file_path, dst_file_path)

         if with_power and mode=='performance' and not compliance_test_name:
-             power_src_dir = power_experiment_entry.get_path("power_logs")
+             power_src_dir = power_experiment_entry.call("get_path", ["power_logs"])
              dir_list = ['power', 'ranging', 'run_1']

              for elem in dir_list:
@@ -382,7 +384,8 @@ def lay_out(experiment_entries, division, submitter, log_truncation_script_path,

         save_json(measurements_meta_data, measurements_meta_path, indent=4)

-        experiment_entry.parent_objects = None
+        orphan_entry = experiment_entry.parent_objects[0] if experiment_entry.__class__ == Runnable else experiment_entry
+        orphan_entry.parent_objects = None

         # This is moved to results, but not properly tested
         if with_power:
@@ -540,13 +543,13 @@ Usage examples:

 def generate_readmes_for_measurements(experiment_entries, division, submitter, submitted_tree_path, power, mlperf_round, __entry__=None):

-    readme_template_path = __entry__.get_path("README_template.md")
+    readme_template_path = __entry__.call("get_path", ["README_template.md"] )

     for experiment_entry in experiment_entries:

         scenario        = experiment_entry['loadgen_scenario'].lower()

-        src_dir         = experiment_entry.get_path("")
+        src_dir         = experiment_entry.call("get_path", [""])
         sut_name        = experiment_entry.get('sut_name')

         loadgen_mode    = experiment_entry.get('loadgen_mode')
@@ -555,7 +558,7 @@ def generate_readmes_for_measurements(experiment_entries, division, submitter, s
         target_qps = experiment_entry.get("loadgen_target_qps")
         target_latency = experiment_entry.get("loadgen_target_latency")

-        experiment_cmd  = 'axs byquery ' + experiment_entry.get('__query')
+        experiment_cmd  = 'axs byquery ' + (experiment_entry.get('__query') or experiment_entry.parent_objects[0].get('__query'))
         #experiment_cmd  = experiment_entry.get('produced_by')
         compliance_test_name      = experiment_entry.get('loadgen_compliance_test')

@@ -642,7 +645,7 @@ def generate_table(experiment_entries, division, submitter, power, __entry__):

         scenario = experiment_entry['loadgen_scenario']

-        entry_path = experiment_entry.get_path("")
+        entry_path = experiment_entry.call("get_path", [""])
         if power:
             power_experiment_path = os.path.join(entry_path, 'power_logs')
             performance_dir_path = os.path.join(power_experiment_path, 'run_1')

[maria-18-git]

Run submitter + checker:

maria@slurm-master:~/work_collection/axs2mlperf_mlperf_6_0$ axs byname submitter , full_run --framework=kiss_v --task=text_to_video --division=open --sut_name=b300_n2-kissv --program_name=text_to_video_using_kissv --submitter=Krai --dataset_name=text_to_video --infer_from_ss+
...
  Creating SUT description: b300_n2-kissv  -->  /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/systems/b300_n2-kissv.j
son
Run checker...
WARNING:maria@slurm-master code_axs.py:run:67 shell.run() about to execute (with in_dir=None, env=None, capture_output=False, errorize_output=False, capture_stderr=True, split_to_lines=False):
        "/usr/bin/python3.12" /home/maria/work_collection/mlperf_inference_git_master/tools/submission/submission_checker/main.py --version v6.0 --input /home/maria/work_collection/laid_out_sub
mission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree --csv /dev/null
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2026-03-04 14:32:55,814 loader.py:193 INFO] Loading System log from /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/sy
stems/b300_n2-kissv.json
[2026-03-04 14:32:55,815 loader.py:193 INFO] Loading Performance log from /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Kr
ai/results/b300_n2-kissv/wan-2.2-t2v-a14b/offline/performance/run_1/mlperf_log_detail.txt
...
[2026-03-04 14:32:55,818 base.py:42 INFO] Starting system checks for: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/r
esults/b300_n2-kissv
[2026-03-04 14:32:55,818 base.py:45 INFO] All system checks checks passed for: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/op
en/Krai/results/b300_n2-kissv
[2026-03-04 14:32:55,818 base.py:42 INFO] Starting measurement checks for: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/K
rai/results/b300_n2-kissv/wan-2.2-t2v-a14b/singlestream/measurements.json
[2026-03-04 14:32:55,818 base.py:45 INFO] All measurement checks checks passed for: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tr
ee/open/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/singlestream/measurements.json
[2026-03-04 14:32:55,818 base.py:42 INFO] Starting base checks for: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/res
ults/b300_n2-kissv/wan-2.2-t2v-a14b/singlestream/performance/power
[2026-03-04 14:32:55,818 base.py:45 INFO] All base checks checks passed for: /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open
/Krai/results/b300_n2-kissv/wan-2.2-t2v-a14b/singlestream/performance/power
[2026-03-04 14:32:55,818 main.py:215 INFO] ---
[2026-03-04 14:32:55,818 main.py:219 INFO] Results /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/results/b300_n2-kiss
v/wan-2.2-t2v-a14b/offline/performance/run_1/mlperf_log_detail.txt 19943300512.0
[2026-03-04 14:32:55,818 main.py:219 INFO] Results /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree/open/Krai/results/b300_n2-kiss
v/wan-2.2-t2v-a14b/singlestream/performance/run_1/mlperf_log_detail.txt 19943300512.0
[2026-03-04 14:32:55,818 main.py:221 INFO] ---
[2026-03-04 14:32:55,818 main.py:310 INFO] ---
[2026-03-04 14:32:55,818 main.py:311 INFO] Results=2, NoResults=0, Power Results=0
[2026-03-04 14:32:55,818 main.py:318 INFO] ---
[2026-03-04 14:32:55,818 main.py:319 INFO] Closed Results=0, Closed Power Results=0

[2026-03-04 14:32:55,818 main.py:324 INFO] Open Results=2, Open Power Results=0

[2026-03-04 14:32:55,818 main.py:329 INFO] Network Results=0, Network Power Results=0

[2026-03-04 14:32:55,818 main.py:334 INFO] ---
[2026-03-04 14:32:55,818 main.py:336 INFO] Systems=1, Power Systems=0
[2026-03-04 14:32:55,818 main.py:340 INFO] Closed Systems=0, Closed Power Systems=0
[2026-03-04 14:32:55,818 main.py:345 INFO] Open Systems=1, Open Power Systems=0
[2026-03-04 14:32:55,818 main.py:350 INFO] Network Systems=0, Network Power Systems=0
[2026-03-04 14:32:55,818 main.py:355 INFO] ---
[2026-03-04 14:32:55,818 main.py:360 INFO] SUMMARY: submission looks OK

[maria-18-git]

maria@slurm-master:~/work_collection/axs2mlperf_mlperf_6_0$ tree -a /home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree
/home/maria/work_collection/laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv/submitted_tree
└── open
    └── Krai
        ├── results
        │   └── b300_n2-kissv
        │       └── wan-2.2-t2v-a14b
        │           ├── offline
        │           │   ├── README.md
        │           │   ├── accuracy
        │           │   │   ├── accuracy.txt
        │           │   │   ├── mlperf_log_accuracy.json
        │           │   │   ├── mlperf_log_detail.txt
        │           │   │   └── mlperf_log_summary.txt
        │           │   ├── measurements.json
        │           │   ├── mlperf.conf
        │           │   ├── performance
        │           │   │   └── run_1
        │           │   │       ├── mlperf_log_detail.txt
        │           │   │       └── mlperf_log_summary.txt
        │           │   └── user.conf
        │           └── singlestream
        │               ├── README.md
        │               ├── accuracy
        │               │   ├── accuracy.txt
        │               │   ├── mlperf_log_accuracy.json
        │               │   ├── mlperf_log_detail.txt
        │               │   └── mlperf_log_summary.txt
        │               ├── measurements.json
        │               ├── mlperf.conf
        │               ├── performance
        │               │   └── run_1
        │               │       ├── mlperf_log_detail.txt
        │               │       └── mlperf_log_summary.txt
        │               └── user.conf
        ├── src
        │   └── wan-2.2-t2v-a14b
        │       └── text_to_video_using_kissv
        │           └── README.md
        └── systems
            └── b300_n2-kissv.json

18 directories, 22 files

[maria-18-git]

Git commit:
[submitter]: lay_out with infer_from_ss+ created SS and Offline subdirectories in submitted tree correctly

[maria-18-git]

Status: Done.

[maria-18-git]

Move to another directory.

maria@slurm-master:~/work_collection$ mv laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv laid_out_submission_open_text_to_video_using_kiss_v_on_b300_n2-kissv_from_SS_final