Skip to content

Comments

Add support for vLLM#47

Open
Adam-Mazur wants to merge 1 commit intoopenai:mainfrom
Adam-Mazur:add-vllm
Open

Add support for vLLM#47
Adam-Mazur wants to merge 1 commit intoopenai:mainfrom
Adam-Mazur:add-vllm

Conversation

@Adam-Mazur
Copy link

This PR allows using vLLM to calculate the automated interpretability score.

Since many OpenAI API functionalities have been depracated, I tried to replace it with a local vLLM server.

Instructions on how to calculate the autointerpretability score with vLLM are in:

neuron-explainer/demos/generate_and_score_explanation.ipynb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant