-
Notifications
You must be signed in to change notification settings - Fork 89
Open
Description
Would this work when running the integration test with huggingface/tgi
I noticed that it sets the api_base in the model args:
| model_args["api_base"] = os.environ["HF_ENDPOINT"] |
and agent_config.api_base might be None.
If thats the case, we might need something like:
agent_config.api_base or cast(
"str | None", model_args.get("api_base")
)
Originally posted by @HareeshBahuleyan in #840 (comment)
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels