ait/features: add tool call page #3096
Conversation
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
| Tool call arguments can be streamed token by token as they are generated by the model. When implementing token-level streaming, your UI should handle parsing partial JSON gracefully to render realtime updates as the arguments stream in. To learn more about approaches to token streaming, see the [token streaming](/docs/ai-transport/features/token-streaming) documentation. | ||
| </Aside> | ||
|
|
||
| ## Human-in-the-loop workflows <a id="human-in-the-loop"/> |
There was a problem hiding this comment.
You mention HITL, but what about other tool calls that are invoked client-side? Eg to get location, read or send texts on a mobile, upload photos etc.
GregHolmes
left a comment
GregHolmes
left a comment
There was a problem hiding this comment.
Only small points really.
|
|
||
| <Code> | ||
| ```javascript | ||
| const channel = ably.channels.get('{{RANDOM_CHANNEL_NAME}}'); |
There was a problem hiding this comment.
You've used realtime.channels.get and ably.channels.get is it worth making sure they're either or and not both?
|
|
||
| if (name === 'get_location') { | ||
| const result = await getGeolocationPosition(); | ||
| await channel.publish('tool_result', { |
There was a problem hiding this comment.
Do we need to include the responseId here? we're retrieving it above, (line 213) but not using it.
Adds a page to the Messaging section that describes sending tool calls and results to users over channels. Indicates ability to build generative user interfaces or implement human in the loop workflows.
mschristensen
force-pushed
the
feature/AIT-263-tool-calls
branch
from
a6256b3 to
ecd60da
Compare
mschristensen
merged commit adfe7bc
into
AIT-129-AIT-Docs-release-branch
Description
Adds a page to the Messaging section that describes sending tool calls and results to users over channels. Indicates ability to build generative user interfaces or implement human in the loop workflows.
Checklist