-
Notifications
You must be signed in to change notification settings - Fork 93
Closed
Description
Libraries
- put a note in models/README.md that a lot of models are currently missing (may be outdated by Vision models migration to 2.0 #498)
- generic (domain-specific) tests to run on every new model in vision (add generic model plugin tests #433)
- Make automerge dependent on Jenkins test status (Make automerge contingent on both Travis and Jenkins #443)
- Why isn't secrets access working in Travis? (@kvfairchild)
- plugin versioning (@shehadak)
- figure out the disconnect in expected test and current/website scores for AlexNet (@shehadak)
- Add models (Vision models migration to 2.0 #498) and close any outdated model-adding PRs (e.g. Integrate models/submission fixes #385, integrate models #357)
- Rename
mastertomainin vision and web repositories (note: need to ask Martin his opinion on this first)
Submission (web) (@mike-ferguson)
- the UI offers options for private submissions and for submitting a base model (vs. brain model), neither of which we currently support.
- when a submission is incorrectly packaged, the redirect to submit again is http://www.brain-score.org/profile/vision/submit which leads to
Not Found - when a submission is incorrectly packaged, the error message "Please make sure your models/regnet/ folder contains at least one of the following folders:[metrics, data, benchmarks, models]. The submission packaging rules can be found here." is not very informative, the link is just to generic docs, and we do not actually specify the packaging instructions anywhere in the docs.
- when a
submission.zipis structured with a<zip>/models/regnet/{__init__.py, model.py, test.py}folder structure, it fails with a confusing error message (above). The correct structure would be to have<zip>/submission/models/regnet/...but this is not obvious from the error message
Admin
- put a note in model-tools, candidate-models, and sample-model-submission READMEs that the repositories are discontinued and integrated into vision (@mike-ferguson )
- incorporate Terms and Conditions (waiting for legal counsel)
Metadata
Metadata
Labels
No labels