Skip to content

Adding OpenAI base url as env variable and more #80

@tupe2009

Description

@tupe2009

Hi, awesome project!

Many RAG projects use offline embedding/LLM models for local usage. These projects usually use hosting services (Ollama, VLLM, XInference and more) which support the OpenAI schema.

Adding a base URL to the OpenAI schema might allow more users to use this project!

Side note:
Model selection in LlamaIndex for OpenAI is limited to the actual OpenAI models, so an OpenAI-like option could be awesome, or users could just use a proxy like LiteLLM on their end :)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions