Skip to content

Docker Image for RAG applications#6

Open
ElNandes wants to merge 2 commits intoa2s-institute:masterfrom
ElNandes:master
Open

Docker Image for RAG applications#6
ElNandes wants to merge 2 commits intoa2s-institute:masterfrom
ElNandes:master

Conversation

@ElNandes
Copy link

Hello,

The image build on top of the ml-notebooks images and includes the following additions:

  • ollama server to download and use llms locally
  • llama-index and its dependencies, and chromadb
  • A script chroma_fix.sh that fixes some dependency issues with chromadb

Regards
Elanton

@mhwasil
Copy link
Member

mhwasil commented Oct 22, 2024

Just saw this PR!
I think it's better to integrate this to the nlp-notebook directly, but remove the CMD ["ollama","serve"] because this is used to run jupyterhub singleuser here

instead of permanently running ollama, the user can run ollama if needed only

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants