Error fetching models in use-package but otherwise it works

[oatmealm]

Hi there!

I'm not sure why robby attempts to access the api immediately before I use any command (I guees it might be llm library [?]...

But still... this fails all the time, even though robby-chat works as expected afterwords

(use-package! robby
  :custom
  (robby-api-url "https://api.together.xyz/v1/chat/completions")
  (robby-openai-api-key "xxxxxx")
  (robby-chat-model "mistralai/Mistral-7B-Instruct-v0.2")
  :config
  (robby-mode))

Also this, when calling robby-chat the first time only.

(use-package! robby
  :custom
  (robby-api-url "https://api.together.xyz/v1/chat/completions")
  (robby-openai-api-key "xxxxx")
  (robby-chat-model "mistralai/Mistral-7B-Instruct-v0.2")
  :commands (robby-chat))

Debugger entered--Lisp error: (error "Error fetching models: \"Incorrect API key provided...")
  error("Error fetching models: %S" "Incorrect API key provided: xxxxxx**************...")
  robby--get-models()
  byte-code("\300\301\302\303#\210\300\301\304\305#\210\300\301\306\307\310\301\311\312$#\210\300\301\313\314\315\316\317\320D\315\321\322\323\317\324\325\326\310\300\327\302\303#\210\300\327\330..." [put robby-api-options interactive-only t function-documentation "Chat API option transient." transient--prefix transient-prefix :command :init-value robby--init-api-options transient--layout vector 1 transient-column :description "Chat API Options" transient-option :key "m" "model" :argument "model=" transient:robby-api-options:model= completion-predicate transient--suffix-only defalias transient--default-infix-command :always-read :choices robby--get-models "t" "max tokens" "max-tokens=" transient:robby-api-options:max-tokens= :reader transient-read-number-N+ "e" "temperature" "temperature=" transient:robby-api-options:temperature= robby--read-temperature "p" "top p" "top-p=" transient:robby-api-options:top-p= robby--read-top-p "n" "n=" transient:robby-api-options:n= ...] 28)
  require(robby-transients)
  load-with-code-conversion("/home/uri/.config/emacs/.local/straight/build-29.3..." "/home/uri/.config/emacs/.local/straight/build-29.3..." nil t)
  require(robby nil nil)
  (progn (let ((custom--inhibit-theme-enable nil)) (if (memq 'use-package custom-known-themes) nil (custom-declare-theme 'use-package 'use-package-theme nil (list)) (enable-theme 'use-package) (setq custom-enabled-themes (remq 'use-package custom-enabled-themes))) (custom-theme-set-variables 'use-package '(robby-api-url "https://api.together.xyz/v1/chat/completions" nil nil "Customized with use-package robby") '(robby-openai-api-key "6f42180af007c79699ab1beb1b6e63507a76136dbb72e79a99..." nil nil "Customized with use-package robby") '(robby-chat-model "mistralai/Mistral-7B-Instruct-v0.2" nil nil "Customized with use-package robby"))) (require 'robby nil nil) (robby-mode) t)
  (progn (progn (let ((custom--inhibit-theme-enable nil)) (if (memq 'use-package custom-known-themes) nil (custom-declare-theme 'use-package 'use-package-theme nil (list)) (enable-theme 'use-package) (setq custom-enabled-themes (remq 'use-package custom-enabled-themes))) (custom-theme-set-variables 'use-package '(robby-api-url "https://api.together.xyz/v1/chat/completions" nil nil "Customized with use-package robby") '(robby-openai-api-key "6f42180af007c79699ab1beb1b6e63507a76136dbb72e79a99..." nil nil "Customized with use-package robby") '(robby-chat-model "mistralai/Mistral-7B-Instruct-v0.2" nil nil "Customized with use-package robby"))) (require 'robby nil nil) (robby-mode) t))
  elisp--eval-last-sexp(nil)
  eval-last-sexp(nil)
  eros-eval-last-sexp(nil)
  funcall-interactively(eros-eval-last-sexp nil)
  command-execute(eros-eval-last-sexp)

[oatmealm]

BTW, same error appears when trying to call the robby-commands transient menu... even though most commands are already able to access the alternative API as customized above... could it have something to do with the hard coded URL in robby--get-models?

robby--get-models: Error fetching models: "Incorrect API key provided: 6f42180a****************************************************f9ba. You can find your API key at https://platform.openai.com/account/api-keys."

When I replace url robby-api-url:

  (if robby-models
      robby-models
    (let* ((inhibit-message t)
           (message-log-max nil)
           (url robby-api-url)
           (url-request-method "GET")
           (url-request-extra-headers
            `(("Content-Type" . "application/json")
              ("Authorization" . ,(concat "Bearer " (robby--get-api-key)))))
           (inhibit-message t)
           (message-log-max nil))

if: Error fetching models: "Only POST requests are accepted."

[stevemolitor]

Thanks for the report. It looks like I have an auto-loading / early-loading problem re the API key. I'll sort that out.

Also, I missed the hard-coded API URL in the get models call. I'll fix it. I might also provide an option to turn off the fetching of the models and just let the user type in a string.

It may be a day or two.

[stevemolitor]

OK, I figured out the issues and have a partial fix in #3. Use the fix-2 branch to try it out.

See #3 for details: it's a temporary, WIP workaround. The issues look easy enough to fix but I won't have time today. This should get you going in the meantime though.

Thanks again for the feedback.

[oatmealm]

Thanks, @stevemolitor, I'll take a look.

Also, thanks for starting this project. I love how streamlined and integrative the experience is. I'm yet to explorer the "builder" and custom commands infrastructure, which sounds exceptionally useful.