Skip to content

Latest commit

 

History

History
executable file
·
37 lines (24 loc) · 2.09 KB

File metadata and controls

executable file
·
37 lines (24 loc) · 2.09 KB

Helpful scripts for running evaluations

As main.py has many command line arguments, retyping it on terminal every time becomes cumbersome.

We prepared inference_base.sh, which can be used as a template for running experiments.

Here are some samples of how it can be used:

# Our IROS submission configuration
./scripts/inference_base.sh 0 821 0 valid_unseen testrun mlm mlmscore_equal "aggregate_sum sem_search_all spatial_norm temperature_annealing new_obstacle_fn no_slice_replay" 1 240 1 high local_adjustment 0.5 9

# Random collocation map
./scripts/inference_base.sh 0 821 0 valid_unseen random none mlmscore_equal "aggregate_sum spatial_norm sem_search_all new_obstacle_fn no_slice_replay" 1 240 1 high

# FILM
./scripts/inference_base.sh 0 821 0 valid_unseen cnn cnn mlmscore_equal "aggregate_sum spatial_norm sem_search_all new_obstacle_fn no_slice_replay" 1 240 1 high

# Ground truth language instruction for ablation studies
./scripts/inference_base.sh 0 821 0 valid_unseen testrun mlm mlmscore_equal "aggregate_sum sem_search_all spatial_norm temperature_annealing new_obstacle_fn no_slice_replay" 1 240 1 gt local_adjustment 0.5 9

# Low level instruction for ablation studies
./scripts/inference_base.sh 0 821 0 valid_unseen testrun mlm mlmscore_equal "aggregate_sum sem_search_all spatial_norm temperature_annealing new_obstacle_fn no_slice_replay" 1 240 1 low local_adjustment 0.5 9

Other inference_*sh files

We prepared convenience scripts other than inference_base.sh for following cases.

name Purpose
inference_debug.sh For debugging. Can set set_trace and debug interactively.
inference_gtSemDepth.sh For ablation study. Use ground truth depth and instance segmentation.
inference_manual.sh For debugging. Manually run the agent.
inference_pics.sh Output various information (agent view, segmentation/depth estimation, etc.) during inference.