Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .githooks/pre-push
Original file line number Diff line number Diff line change
Expand Up @@ -16,9 +16,9 @@ echo "pre-push: running make typecheck"
make typecheck

# Check extras if they exist and have changes
if [ -d "evaluators/extra/galileo" ]; then
echo "pre-push: checking evaluators/extra/galileo"
cd evaluators/extra/galileo
if [ -d "evaluators/contrib/galileo" ]; then
echo "pre-push: checking evaluators/contrib/galileo"
cd evaluators/contrib/galileo
uv run --extra dev ruff check --config ../../../pyproject.toml src/
uv run --extra dev mypy --config-file ../../../pyproject.toml src/
cd "$REPO_ROOT"
Expand Down
30 changes: 30 additions & 0 deletions .github/ISSUE_TEMPLATE/general.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
---
name: General issue
about: Report a bug, request a feature, or propose a change
title: ""
labels: []
assignees: []
---

## Summary
- What is the problem or request?

## Motivation
- Why does this matter?

## Current behavior
- What happens today?

## Expected behavior
- What should happen instead?

## Reproduction (if bug)
1.
2.
3.

## Proposed solution (optional)
- Suggested approach, tradeoffs, or constraints.

## Additional context
- Links, screenshots, logs, related issues/PRs.
21 changes: 21 additions & 0 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
## Summary
- What changed and why.

## Scope
- User-facing/API changes:
- Internal changes:
- Out of scope:

## Risk and Rollout
- Risk level: low / medium / high
- Rollback plan:

## Testing
- [ ] Added or updated automated tests
- [ ] Ran `make check` (or explained why not)
- [ ] Manually verified behavior

## Checklist
- [ ] Linked issue/spec (if applicable)
- [ ] Updated docs/examples for user-facing changes
- [ ] Included any required follow-up tasks
4 changes: 2 additions & 2 deletions .github/workflows/release.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ jobs:
if: steps.release.outputs.released == 'true'
uses: pypa/gh-action-pypi-publish@release/v1
with:
packages-dir: evaluators/extra/galileo/dist/
packages-dir: evaluators/contrib/galileo/dist/
user: __token__
password: ${{ secrets.PYPI_API_TOKEN }}

Expand All @@ -87,4 +87,4 @@ jobs:
evaluators/builtin/dist/*
sdks/python/dist/*
server/dist/*
evaluators/extra/galileo/dist/*
evaluators/contrib/galileo/dist/*
4 changes: 2 additions & 2 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ Forwarded targets:
- `server/`: FastAPI server (`server/src/agent_control_server/`)
- `sdks/python/`: Python SDK — uses engine for evaluation (`sdks/python/src/agent_control/`)
- `evaluators/builtin/`: builtin evaluator implementations (`evaluators/builtin/src/agent_control_evaluators/`)
- `evaluators/extra/`: optional evaluator packages (e.g., `evaluators/extra/galileo/`)
- `evaluators/contrib/`: optional evaluator packages (e.g., `evaluators/contrib/galileo/`)
- `ui/`: Nextjs based web app to manage agent controls
- `examples/`: runnable examples (ruff has relaxed import rules here)

Expand Down Expand Up @@ -75,7 +75,7 @@ All testing guidance (including “behavior changes require tests”) lives in `
5) evaluator is automatically available to server and SDK via `discover_evaluators()`

- Add an external evaluator package:
1) copy `evaluators/extra/template/` as a starting point
1) copy `evaluators/contrib/template/` as a starting point
2) implement evaluator class extending `Evaluator` from `agent_control_evaluators`
3) add entry point using `org.name` format (e.g., `galileo.luna2`)
4) package is discovered automatically when installed alongside agent-control
Expand Down
Loading
Loading