-
Notifications
You must be signed in to change notification settings - Fork 3
Swap neutral to abstain and have LLM judge yes|no|abstain #63
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
I've run the migration and tested things out and it works as expected. This one is a non-trivial refactor and would benefit from a careful code review. |
|
Did you run the migration against the prod database? I will review this but I will let @mikaalnaik approve/not because he's most familiar with how this all works |
|
No I have not run the migration on prod. That would happen once this is approved and ready to go. And I should note that this is a fairly rudimentary migration (ie: run a mongo command). It would be great to get the dev environment up to test this on.
|
|
I've added a new script I've also updated the in memory page cache to only be turned on with |
|
We're now displaying the vote in the UI that the LLM returned. We want clean separation of concerns between how a bill is analyzed and how we display the analysis. |
This feature changes:
neutraltoabstain(an MP can voteyes,no, orabstainso we want to match that)abstainjudgement to the LLM system prompt rather than having our code swap ayesornotoneutral/abstainby checking if it's a social issue or if one tenet response is different from all othersneutraltoabstainand update prompt to judgeyes,no, orabstain#61