The tests will do things like "ho install delegates 1-50", assuming they will fail because of absence of aws.yaml file - however, in the presence of an aws.yaml file they can succeed and cause trouble, incur costs etc.
Add a check for the presence of aws.yaml and refuse to run tests if it evaluates to true.