Make the human judgement tooling easier to reuse.

[seabbs]

Hi hi,

I really like the human judgment tooling y'all have implemented. I teach a few courses on forecasting-related stuff and I would be really keen to use it as part of that if possible. It would also be generally useful as a research tool in the future but no concrete plans for that at the moment.

In terms of what that would look like I would really like to be able to use it on different datasets, have a custom leaderboard, and be able to get at the backend forecasts in someway. Some or all of that would be great.

In terms of use having it as a standalone tool we can hack on would be best but a hosted solution would also be good.

[jcblemai]

Thanks Sam. We will implement that. Am I correct that an web app you can run locally, and that stores results locally as json (or in google spreadsheets, what we use for tournaments) is something that would address this issue ?

[seabbs]

Yes that would be absolutely ideal

[seabbs]

I spoke to a few people about this and seeing some wider interest in having something like this for teaching FYI (they may turn up on this issue)