Use this guide when running large-scale experiments on Linux/macOS.
- Python 3.10+
uvopenclawCLI available inPATH- Running OpenClaw/EcoClaw runtime
From repo root:
cp .env.example .envSet at least:
ECOCLAW_API_KEY=sk-xxx
ECOCLAW_BASE_URL=https://concept.dica.cc/llm
ECOCLAW_MODEL=claude-haiku-4.5
ECOCLAW_JUDGE=gpt-5-nanoIf PinchBench skill is not at ../skill or ~/skill, set:
ECOCLAW_SKILL_DIR=/absolute/path/to/skillchmod +x experiments/scripts/*.shSingle-task sanity check:
./experiments/scripts/run_pinchbench_baseline.sh --suite task_00_sanity --runs 1
./experiments/scripts/run_pinchbench_ecoclaw.sh --suite task_00_sanity --runs 1Full automated suite:
./experiments/scripts/run_pinchbench_baseline.sh --suite automated-only --runs 1
./experiments/scripts/run_pinchbench_ecoclaw.sh --suite automated-only --runs 1Compare:
./experiments/scripts/compare_pinchbench_results.shReport output:
results/reports/pinchbench_comparison.json