Skip to content

Comments

replace AsyncOpenAI with llama_index (WIP)#7

Open
jlzhou wants to merge 1 commit intoMFYDev:mainfrom
jlzhou:llamaindex2
Open

replace AsyncOpenAI with llama_index (WIP)#7
jlzhou wants to merge 1 commit intoMFYDev:mainfrom
jlzhou:llamaindex2

Conversation

@jlzhou
Copy link
Contributor

@jlzhou jlzhou commented Feb 4, 2025

I haven't done complete tests on models apart from Ollama local models.

TODO:

  1. Complete tests on openai and other remote LLM service(Need help)
  2. Add llama_index dependencies into requirements.txt
  3. Add extra model config params in settings
  4. Update README.md to fit in with these changes(Need help)
  5. You need to set OPENAI_API_KEY in environment with openai API

Suggestions and improvements are super welcome!

@jlzhou jlzhou changed the title replace AsyncOpenAI by llama_index replace AsyncOpenAI by llama_index (WIP) Feb 4, 2025
@jlzhou
Copy link
Contributor Author

jlzhou commented Feb 4, 2025

Also, if you're running ollama local embeddings model like nomic-embed-text, you'll need to change 'vector(1536)' to 'vector(768)' in two spots in the init.sql file, then execute it to create/re-create the db table.

@jlzhou jlzhou changed the title replace AsyncOpenAI by llama_index (WIP) replace AsyncOpenAI with llama_index (WIP) Feb 4, 2025
@MFYDev
Copy link
Owner

MFYDev commented Feb 5, 2025

Thank you for the commit, I will review this later this week and will keep you updated!

@MFYDev MFYDev self-requested a review February 5, 2025 16:05
@MFYDev MFYDev added the enhancement New feature or request label Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants