You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Yes, that was a real bug in run_validation_benchmark.py.
Cause:
FP and DC were set here:
run_validation_benchmark.py (line 241)
run_validation_benchmark.py (line 249)
but they immediately hit continue, which skipped the CSV append at:
run_validation_benchmark.py (line 339)
So DC entries were being omitted from benchmark_results.csv, which would absolutely distort the status percentages.
The corrected guard is now:
run_validation_benchmark.py (line 253)
if"[Errno 2] No such file"insim_result.warning_messageor"invalid literal format"insim_result.warning_messageor"invalid literal for int"insim_result.warning_message:
310
-
status="Crashed"
311
-
elifstatusin {"UA", "OA"}:
312
-
print(
313
-
" Error: target assembly was not found after both validation runs. "
314
-
f"Largest observed assembly size was {sim_result.largest_observed_assembly_size} "
315
-
f"vs target size {target_assembly_size}."
316
-
)
274
+
275
+
# 3. If the target never appears in the histogram, rerun longer.
276
+
ifnotsim_result.full_assembly_found:
277
+
print(
278
+
" -> Target composition did not appear within "
279
+
f"{FAST_VALIDATION_ITERATIONS} iterations; rerunning with {args.iterations} iterations."
if"[Errno 2] No such file"insim_result.warning_messageor"invalid literal format"insim_result.warning_messageor"invalid literal for int"insim_result.warning_message:
309
+
status="Crashed"
310
+
elifstatusin {"UA", "OA"}:
311
+
print(
312
+
" Error: target assembly was not found after both validation runs. "
313
+
f"Largest observed assembly size was {sim_result.largest_observed_assembly_size} "
0 commit comments